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ABSTRACT 



This paper describes and* discusses three studies 
k^the repre^ntation of cb:^3ren*s knowledge as revealed^ 
children, a^es 5 to l'7# perform a scientific 



concerned vitl 

in the ways thL , ^ ^ , 

induction task* invariant of Piaget*s balance scale prediction 
^ probliam was chosei\as the ei^perimental telsk; a formal model for 

different levels o^^children's knowledge about how to do the tasjt was 
constructed* Experiment I was conducted to assess the validity oi 
^ this model* Experimenrs.II examined some inst^t^ctional issues and 
^ revealed some limitatiot\s of the initial rep»^bntatiQ]>* The f^sults 
indicatftja that older andXyounger children who w^se initially 
classified by the model asvhaving identical task-sjlfeqif ic knowledge, 
showed a striking difference in responsiveness " to instruction* This 
finding led ^to revising the original representation by an^'ij^ing the 
problem-by*pr6blem perf ormance\pf two children during a trai|£i^ 
sequence and. using this informaffion to formulate a detailed 
production system model of one child* s knowledge* This model iras tl 
ru^ as'a computer simula^tion and a>comparison of the computer result) 
with the child'tS .performance suggested that the initi^l-^encoding of 
the stimulus may account for the perftarmance diff^etices between 
older and younger children; Experimental! was q^nducted to test this 
'encoding hypothesis* Finally, the types^nd levels of knowledge that 
might be important in instructional inves^ig^tioh were discussed. 
<Author/JHB) 
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THE REPRESENTATION OF CHILIM^EN'S KNOWLEDGE 
David Klahr & Robert S. Siegler 
Carnegie -MeHonUmversity 



Hthis paper we wilt discuss tyo related issues. One issue concerns the ways 
that chlldiKSn from 5 to 17 years perform a scientific induction task. We will summarise 
a series of experiments designea to investigate questions about initial 
Knowledge, instructional effective wss» and individual differences in both initial 
performance and responsiveness to instruction. The second issue is methodologieair 
its focus is not on what we can sajf about children's Knowledge of a task, but rather 
On h<>>^ can say it. That is, tijie second issue we address is the representation 
of chitdren's knowledge. 

The two issues are^related pimply beaause the researcher's decision about how 
to represent knowledge plays a /central rcpe in guiding both the kind oif theory that 
gets formulated and the kintJ of [experiment that gets rua We have found this to be 
the case in our own studies, am we belifeve that It might be worthwhile to direct 



.attention to 
among them. 



some properties o 



differeni representations and criteria for choosing 



Our discussion will mov^ back and forth between 'general conceptual Issues 



and some very specific exartples of 
statements. This wilt give ths paper 
sketch the structure at the outlet: 



L From Behavioral to Cognitive Objectives 



t)oth empirical techniques and theoretical 
a rather complex organization, so we wilt 



First we describe the historical trehd in instructional psychology that h&s made 
the representation of knowledge a centraMssue. ' 



II. Some Criteria for Choosing a Representation. 

Then we tntro^luce criteria that we believe might be useful in choosing an^ 
evaluating <Jifferent representations. In addftion to a set of evaluative criteria, we list 
five central questions for research in developmental and instructional psychology. 



III- The Balance "Scale Task 



Next we introduce a specific task that has interesting psychological and 
instructional properties: a variant of Piaget*s balance scale prediction problem. We 
present a formal model * using a parHcutar representation - for different levels of 
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knowledge that children might have about how to do the task the task provides the 
concrete reference lor^the remainder of our paper 

IV. Experiment 1: Assessing Initial Knowledge. 

^ Hchring described the formal properties of the task, and some predictions about 
the performance of different aged children on it, we th^p^ describe our first 
experiment. Based upon the results of the experiment, we are able to evaluate the 
^initial hypotheses, as well as to examine th9 merits and limit ations of the 
representation in which the initpl models are stated, 

V. Experiment 2: Training on the Balance Scale Task ^ ^ 

The Initial representation and the associated experiment enable us to make 
certain predictions about the effects of an instructional sequence. In the ''second 
experiment we explore some instructional issues, and this in turn reveals some 
limttations of- the initial represenlation. In parlicular, we find thai older and younger 
chitdren who are initially classified by our models as having identical task'-specific 
knowtedge, show a striking differential responsiveness to instruction. This presents a 
serious challenge to our initial representation of children's knowledge. It is clear 
thai th^ initial formulation does not telC Jhe whole story about vdifferenCes in task 
specif ic^nowledge,' ,1 

VI. R6vjse<i| tepresentations for balance scale Knowledge, 

A fl^vised representation of the knc^tedge required to perform ^at different 
fevels ^ iht/'oduced. The representation is a production system, and some of the 
eeneran pnQiberties of production systems are discussed. Then we present an 
a\ia1ysi?l}inhhe problem-by-^roblem performance of Iwo children-durlng a training 
seciuencel a^d formulate a mor6 detailed production system model of the knowledge of 
One of t^bm^'^ The model is actually run as A computer simulation and its i'esults 
are coh^pdijpid with the child's performance. This tine grained analysis suggests 
that the ^infRs) encoding o1 the stimulus m^y be a crucial difference between older 
and young^f xhitdren, and )hat< this ^mdy account for the. results of Experiment -2, 



VII, Expert 




The encoding hypothesis 



The ^if^ding hypothesis states that Uifferential responsiveness to Jralnin^ 
between 5^laiH|i8 year old chifdren is due to di\ferences in the way lhat Ihey encod^ 
the balanc^ ficljle dimensions. The explanatory ijower of the hypothesis is tested )f 
detail irL£xpei^pnent 3, 

VIIL Types of kijowledge in the human information processing system. 

We conctiioe with a brief discussion of the seWal types and levels Jot 
knowledge that might be important in instructional invesH^tion, Different levpls 
of aggregation ojf< both model and data are obviously appropriate for different 
scientific question?. The direct and explicit consideration of some ways, to repreaent 
knowledge provides useful guidelines for further empirical work, V 
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^ From Behavioral to Cognitiv6/5blf?ctives 

The goal of any instructional effort is the prffduction of n^w Knowledge in the 
learner. Over the last 15 years ol instructional resear'ch there has be^n an increasing 
emphasis on stating suci) goats as clearly as possible. The trend was to move tfom 
in emphasis on simply describing educational means -\the sequence of instructional 
activities - to a prioPstatement of the desired ends of^instruction. ^ The elaboration 
of behavioral . objectives was perhaps the most extensive formalization ot this 
trendCMager^ 1962K Behavior*- were typically specified in great detail^ although 
the Underlying processes were not: However^ even behavioral objectives have 
impticit In them an underlying cognitive theory: behavior is simply an observable 
indicator of underlying cognitive processes. 

One wDthknown normative^/^iodef for instruction {Glaser^ 1968) stresses the 
need to determine the learrfer^ initiar stat^ as well as the desired end st^e. lt\ 
the original formulations ot^nhis approach^ both initial and iin^l learner^ states werQ 
describediio^rimarily in terms of tasks and subtasks arranged in a Gagne'-like 
hierarchy. There was little mention ot how one might characterize the underlying 
psychological processes that acted upon them to produce the task behavior in 
question- As that approach has developed, however^^it has focused increasingly upon 
such cognitive representations (see Resnick 1976^ for a summary of this trend in the 
area of elementary malhemalics instruction). 



Perhaps the strongest statement ot the destr ability and teasibility of 
describing* the learner in terms of internal psychological representations is Greeno's 
view of "cognitive (objectives' G|MQp(1976) argues that cognitive psychology 
has now developed powerful -aJHRe^rible' methods for the representation of 
Knowtedgei Using an exampte r^om instruction in elementary fractions, 
Greeno shows how two different views of the conceptual content of the subject 

Salter can be represented explicitly by two quite distinct cognitive structures^ 
hich in turn lead to differential predictions about problem difficulty, problem solving 
strategies^ and optimal procedures for instruction. Without such a reprosentatidn^ 
these ^predictions might have never been made. 

This is essentially the same point stressed by^ Klahr & Wallace (1976) with 
respect to the need for explicit and precise models in cognitive development: "a 
theory of transition can be no^better than the associated theory of what it Is that Is 
Undergoing that transition/' According to this view^ tha first step in the 
formulation of davelopmental theories is the creation of a precise modet of the 
initiat and final form of the cognitive process under investigation. Studies by Baylor 
-* Gascon(l974>, Young(1973>^ and Klahr & Wallace (1976) provide developmental 
modets of this type. \ 

In the area of adult problem solving, ^ similar emphasis on the importance of a 
good representation is made by Simon (1975K He provides an information processing 
analysis of adult performance on a simple tasV (the Tower of Hanoi puzzle) in order to 
demonstrate that several, distinct strategies are all plausible models of task 
po/Tormance. Without an appropriate representational system, the precise distinctions 
among the strategies could not have been made* 
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Some Criteria for Choosing a Representation ^ * 

What con^derations might guide us in the Choice of a representation? 
What kinds of representations' are avaii^blo^ and what are their relative merits? 
Knowledge representalion has become an important topic in-|he emerging field of 
"cognitive .science" CBobrow & Collins, 1975) ?nd some initial attempts to address it 
can be found in BDbni^(Q(l975)p 3ocker-(l975)* Mojore & Nowell (1974)^ and Reddy & 
IMowell (1974). These efforts conslttute the first, steps toward a ful^ fledged 
theory of represent ationp and they have already yielded a reasonable set of 
dimensions with whi^h to characterize different representations. ' 

Although such laxonomrc systems allow us to ctassify representations^ 
they do not make any statements about their relative merits. Regardless of the final 
location of a represental ion along the dimensions of importance^ the ultimate 
evaluation of th&\qualily of a representation depends upon the set of Questions being 
addressed. ^ 

We believe that !n the area of Instruction and development the importani 
questions are: ft 

QL What are the differences in knowledge thai underlie different levels 
of task performance? ^ • . ' : 

Q2. What are the alternalive strategies that might result in any given level 
of task performance? 

, Q3. "for a given level of performance^ what is the optimal level of 
difficulty for an instructional sequence? 

Qfl. What are the critical featuresyof an instructional^ sequence that 
enable tt to have any eff^ecl? 

Q5. When and why will two learners at the same initial perfc/rmance level 
learn differently from the same instructional sequei^ce? 

Or,^to summarize our concerns: what do children know about a laskp how do they 
learn about iti and why do some know more and/or leacn more then olhors? 

Given this set of question&p there are four cploria that we boliovo to be most 
important 1 in choosing a reprVsenlalion: ^ > ^ * - 

""a. The 'representation must bo- suffic'Ienl to account for behavior, Thus^ it 
must have a clear mapping onto the empirical base i| is supposed to account for. 

b. It should be amenable to multiple level analyses. That ts» it should bo easy 
to aggregate and disaggregate the grain of explanalion. For the design of well 
Controlled eKpp^o^ls or curriculum design^ the representation will have to bo 
stated in terfiis of averages across many subjects! it musf be a modal form. For 
detailed* study of individual strategies and component processes^ it must be capable 
of disaggregation without drattic revision. 
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c. The representation should cpnform to the relevant properties of the human 
information processing system is determined by laboratory studies of hum en 
processing capacities. * ^ ^ 

d The representafion should have **developmenta1 tract abilit 
& Wallace; 1970). It should allow us to state both early and later forms of 
competence and provide an easy interpretation of each fnodel as both a 
precursor and successor ot other models in a developmental sequence <setf Resnick, 
1976, for a simifar viewpoint). ^ 



The Balance Scale Task 



The^type of balance scale ^used throughoul our investigation consisted of a 
tw6"arm balance, with several pegs located at equal inlervals along each arm. Small 
circular disks, all of equal weight, were placed on'the pegs in various configurations 
{as shown in Table 1), while the balance was prevented from tipping. The subjects* 
basic task was to predict the direction in which the balance scale would move if it 
were allowed to. In order to answer some^of the questions listed above, several 
variations on this basic theme were 'introduced^ These included asking childr&n to 

explain their predictions, allowing scale to move to its equillbriuip 

*p6sitlonflhus providing feedback ab6ul Ihe accuracy of the predictions), observing an 
^experimenter-controlled series of configurations and their effects, constructing one's 
own configurations, and reconslructing initial configurations from memory {the 
details of these experiments ^ are presented in Siegler, 1976), 

The basic physical concept that underlies the operation oi the balance scale 
is toriliuer the scale will rotate In the direction of the greater of the two ^orqu(ys 
acting \on its arms. The total torqufls^ on each arm i^determined by summing the 
indlviduiH torques produced by the weights on the pegs, and the individual torques 
I tOr 



are in turn computed by multiplying each weight by its distance from the fulcrum. 
Since the Wgs are at equal intervals from the fulcrum, and the weights are all equal, 
a simpler c?ilculati6n is possible. It consists of computing the^sum of the products ot 
number of ^i?ights on a peg times the ordinal position of the peg from the fulcrjjm. 
This isr done f6r each side, ancJ the side with the greater sum of products is the sido 
that ^ill go down {if th^y are equal, the scale will balance). 

The components of this knowledge are acquired over a remarkably long 
span of experience and educeti6n; even 5-year olds often know that balances such 
a^ teeter-totters tlend to faU toward the side with more weight,'whtle many 16-year- 
olds do not know the appropri^e arithmetic Computations for determining the 
balance's behavior (Jackson, 1965i Lee,'f971; Lovell, 1961), It even seems likely that 
most collc;;^ educated adults could not easily state the physical principles that 
underlie the sum-of*procfucts algorithm. Furlhermore, for many configurationsi there 
are shortcuts that eliminate the need to do any arithmetic computation {e.g,,fdentical 
conf igur^t^ons on each arm will balance^ if both weight and distance are greater on one 
side, that side will go down)^. 
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Note lhat the balance scale task shares a common property ol many scientific 
problems I the universal rule tor generating correct predictions is ea^y to 
.describe, and once Known^ it is easily remembered and executed) However, the 
formolatiorv of the rule - either* by induction from empirical examples or by deduction 
from genera) physical principles - is quite dillfcult, 

A representation of children's knowledge about the balance scale 

The knowledge that' children at different leVels^ of J>erlormance have 
about this task can bB rapresenled in the form of*a binary decision trOe, as fihown^ 

Figure 1, The morfel of mature knowledge (Model IV) was suggested by a 
ratiotlal tdi;k aKalysiSydf balance-scale problems (ct. Resnick,1976); the models of 
less sophisticaled )mowledgQ^ (Models I ^ ID) were derived from the empirical 
results of Inhelder and Riaget(1958) and Lee (1971), ^nd from our own pilot studies. 
A child using Model I^lendu only to the number of weights on each cide: If ttiey are^ 
t^e same, the c hi tcisj^r Edicts balance, otherwise he predicts that the side wiTh the 
greater weight -go dowa For a Model H child,- a difference in -weight still 
dominates, but if weight is equal, then a difference in distance is sought. If it axlsts, 
the greater dii^tanc^ determines which side will go down, othervOise the prediction is 
balance. A child using Model 1)1 tests both weight and distance in all cases. If both 
are equal, the child predicts* balance; if only one 16 equal, then the other one 
determines the outcome; if they a^e bottf unequair but on the same side with respect to 
their ineqgality,then that side Is predicted lo go down. However, tn a situation in which 
one side has the greafer weight, while the other has the greater distance, a Model lit 
child, although) recognizing Jhe conflict, does not have a consistent way to resolve it. 
This child simply "muddles througl?" by making a ranrfom prediction. Model IV 
represents "mature" knowledge of the task: since it includes the sum-of-prbduct 
celculation, children using it will always make the correct prediction. Note, however, 
that if they can base their predrction on simpler tests, they will d() so. 



Figure 1 aboV here 



Assessing the accuracy of the representations \ — 

We can determine which - if any - of these four models accurately characterizes 
B child's knowledge about Ihe balance scale task i>y examining his pattern of 
-predfttioos for six types of problems (see Table 1 for an example of each type): 

1) Balance problems, wilh the same configuration of weights on pegs on 
each side of the balance, 

2) Weight problems, with unequal amounts of weight equidistant from 
the fulcrum. 



3) Oliitance problehns, with equal amounts of weight dlffercjpt distances 
from the fulcrum. 
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^A) Conllict-weight problems, with more weight on One sido and "more 
distance" (t,e. Occupied pegs further from the fulcrum) On the other, and 
the configuration such that Ihe side with more weight goes down. 

5) Conflict-distance problems^ similar to conflict- weighty except that the 
sido with more distance goes down. 

6) Conflict-balance problems, like^other conflict problems, except that 

the scale remains balanced. ' ^ ' 

• . r 



Table 1 about here 



Children whose knowledge ' corresponded to different models would display 
drimaticall/ differertt patterns of predictions on the six types of^ problems just 
listed. Those using Model I would consistently make c6rroct predictions On 
balance, weigtit, and conflict -weight problprj^, and they would never be correct 
"^n ^he other three problem types. Children using Model II wodid behave slmUarty 
to those using ^Model I on fivc^ of the six problem typcs^ but thoy would correctty 
sdlvG distance problems. Those following Model Ut would consistently make accurate 
predictions op weight, balance, and distance problems, nnd would perform ^it a rOugMy 
chance level ^ on all conflict tasks. Tfvose using Model IV would solve all problems^of 
all types: 

To the extent that there is a correlation between age and the level Of the 
model which best represents a child's knowledge^ thore should be clear developmental 
patterns for each problem type. The most Inleresting is the i^redrcted decrement in 
performance on conflict weight problems. Children using Models I or II wi)l get these 
problem's right even though they do not see them as conflict problems, whereas 
children using Model III will atlend to the conflicling cues of weight and distance* 
but they ^will have to muddle through, and their resulting predictions will be at a 
chance leveK of performance. Another prediction, shown (n Table 1, rs that .distance 
problems should show a dramatic improvement with age. The youngest subjects ^ 
using Model I - will get them all wrongs whife children using Models 1^ III^ or IV will get 
virtually nbne wrong. By a similar logic each of the problem types yields a ptredicted 
developmental course, the results of which are shown In Table 1 (see Stegler, 1976, 
for a complete analysis). 

Experiment 1: AfcsessinriJnftlal Knowlednei 

The purpose of Experiment 1 was to a^se^s the validity o( the foregoing 
analysis for a group of children spanning a wide* age range 

Mothod ^ ^ / 

Subjects w^pro 120 femalo students from a private school If Pittsburgh, 
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Fifteen students from'efach of 6 grade levels were grouped as shown at the top of 
TtbleZ' 

^ ■ 

Materials included a wooden balance scale^ 10 different^olored metal ^^^elght5J 
and 2 wood blocks. The balance scalers arm was 32 inches long» with 4 pegs on each 
side of the fulcrum. The first peg on each side was three inches from the fulcrum and 
each subsequent peg was three inches from the peg before it. The arm could swing 
freely from the point o| attachment to the futerum^ four inches above the fulcrum's 
base. ^Each metal weight weighed lA ounces^ measured 1 inch in diameter^ end had a 
iiole. in its - middle so that it would fit on the pegs; as many as 6 weights could be 
placed on any one peg. The two blocks ^f wood, each four and one-half inches 'high, 
could be placed under the arm of the balance scali^ to prevent it from moving 
regardless of the configuration of the metal weights on the pegs. , 

Children's knowledge was assessed through a 30 item test^ On each problem the 
experimenter started with an emply balance, the arms of which were supported by the 
two wooden blocks. Then the metal weights were placed on the pegs on the two sides 
of the balance scale, and the child WnS asked to predict whrch side wolild go down or 
whether the scale would balance if'theMwo wo9don blocks, underneath the arhs of the 
balance, were not there. Amo'tg the 30 items were 4 balance, 4 weight, 4 distance, 6 
conflict-weight, 6 conflict-distance, and 6 conflict -balance tasks of the types shown In 
Table 1. 

Children w^ro tested individually in a quiet room in their school. The 
experimenter's initial inslructions werei 

"Today we are going to play with this balance 'scale. The balance- scale 
has these pieces of wood that are all the sam& distance from eactt other 
(pointing to the pegs) and these pieces of melal that all weigh the same." 

At this point the children were encouraged to hold the weights to' see -that they 
weighed the same amount apd to observe the, equal distances between adjacent pegs. 

Children's knowledge was then assessed by presenting them with ^e 30 
problems -described above. Tf\p problems were introduced with the following- 
Insti^uctions: 

Let*s see what you know about Ihe balance scale HI put the weights on 
the pegs in different ways and you tell nie whether this side would go 
down^Dr this side would go down or they would both stay like they are 
now [f J -look the wood blocks away. ''The balanc6 scale won't actually 
move, but you t^lf me how the scale would go if the pieces of wood were 
not there. 

■ . ^ 
Following I his test, children were asked to explain their responses. Children spent 
between 15 ahd 30 minutes on the entire ta^k. 
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Results / • . . ' 

The percent correct predictions lor each problem' type by , each age gro^up is 
shown in table 2. A 4(age) by 6(problem^ type) ANOV^ revealed that both main 
effects and thei^ interaction were significant (p < ,001)* Note that^ the* 
^developmental patterns are very close lo those predicted in Table 1* In particular 
^ there is' a dramati^^ improvement in distance problems and a decrement in 
confticTt-^eight problems. The conflict-weight problems never dW' show an upturn, 
although performance appears to have leveled off for the older age groups, 

^ Mot wpwn in laDle l is The Substantial consp 

>n items^ within each problem lype^ Only on cpnilict -weight problems did accurate' 



In Table 2 is the Substantial consistency that existed'^in performance 

Ikrediction fJecrease'with age, and withrh this category such fletrements occurred on all 
six probte ms, l^e magnilude of the improvement over oge^n the distance problems 
was Unmatched -by lhal pn any of the 26 other items. On all eight of the bajance and 
weight jtemSf but on no other tasks, was the developmental trend minimal 

With one class of CKCeptions, the four niodels make exact predictions about 
w^ich'Of the three possible responses (li^ft down, right down, balance) the subject 
will make on each one of the 30 problem?^ (the exception class contains the 18 
conflict problems for Model III; here the prbdiction is a tack of consistency, i,e« 
^sentially chance responding). Thus, we can compare the response pattern of each 
/child to the predicted patterns for each' ot the models, and classify the child 
^cording to which, if any rule she was using in making her predictions. Using a 
v^ry strict criterion one that would misclassify a random responder less than one 
time in a billion for rules 1,11, or IV, or tess ^han once in ten thousand for rule lit, 
we were able to classify 107 of the 120 children. The results are shown tn Table 3* 
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Children's explanaiions were also used to determine which model the child 
wac using. The criteria for clacsifying according tD explanations were derived from 
a literal interpretation of the models. Altogether, 117 of the 120 children's 
explanations fit one of Ih6 four models. As shown in Table fl, the two classifications - ' 
one derived from children's predlclions, the other from their .explanations - were 
Highly correlated - 89, P < ^001), All of the 23 children :iiidged \6 be using Model I 
i>y the predictions data were judged as using Model I by the explanatiohs criterion 
and all 8 of the children^classifred as; gsing Model IV on the predictions treasure - and 
only those eight - were classified as using Model JV on the explanations measure as 
welt. On the other hand,, many children were classified as using Model It by the 
predictions measure who w\re placed in Model lU by the explanations measure* ^ 

\ 4 

Table 4 about here^ 

^ *. 



One interpretation of this discrepancy between the explanations and predictions 
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*criterirfre that there were some <;hildren who used Modet HI tests, but consistently 
resolved the conflict by relying on the weight cue. Further evtdencythat children 
knev more about IHe balance-scale than is revealed by the predictions 
ctassification comes fr«Qm an analysis of th^ consent of their explanations. Fully 
one-third of the chHdjren advawng Mqti&^Ul explanations cited the ratio 
property bf conflict-^bl^ce probleh>fr-fe:g;!| one.on the third peg equals thr^^,on the 
first ptfg), but not the composition rule necessary for a Model IV placement. 

' ( ■ . ' 

* r ' 

€valuatk>n of decislon-lree representations . . ^ ' - - 

flow well do the decision Itrees used in Figure 1 represent children's 
knowledge on the balance scale iasK? It appears to fare well on the, first and last of 
the four criteria listed earlier* It is clearly adequate to account for the predictions 
data. The problem type by model analysis provided an exhaustive ^ an 
UnamfciRUoys mapping between behavior and theory. The lormal relationshtp 
between the models is one of «)trict inclusion: Model^ i tesfs are included in Mo^ol 
Mt etc. This logical structure pr^edicts an ifwarianrt developmental sequence 
(although we could^ not test this directly in a cross^ectlonal study). 

On the other two criteria - multiple level analysis and integration of 
psychological parameters - the merits of the representation are less clear. The^ 
data can be ^ggregaled and disaggregated belween group and individual levels, hitA- 
Onty two Kinds of analyses prodiction and explanation — are described. Additionallyt 
no statements about psychological - as opposed to logical - properties of the. 
knowledge required to do the tasK have yet been advanced. 

Another orienlation from which to evaluate the representation is to'' ask how welt 
it answers the 5 questions aboOl Inslruction and development that were listed above. 
Thusfar, it has only answered Ql: the difference between high and low 
performers is represented by differences among the four. models.^The models are 
silent On Q2, which addresses ^ the issue of alternative paths to the same 
^performance. This inadequacy -was most noticeable in our. discussion of the 
idiosyncracies that are masked by the "muddle through" category on^ModeL HI; 
Since the models dp not have any represenlatfon for Iheir own Jnducfion, they are 
unable to say anything aboul Q4, 'which asks aboul critical features of the 
instruct ibnat sequence. However, the modjjJr^do. suggest some straight toward 
ways to emptric^alfy investigate Q3 ( howy^^ficult should an instructional sequence 
be?), and they imply thai there should (be no differences In responsiveness to 
inslruction, Ihus providing an assertion! thal^ refutes, thft. premise t>f-Q5. In 
Evpertment^, we addressed these issues suggested by Q3 and\)5. 



E)tPeriment 2: Traininp. on the Balance Scale 'Task ' 

fn the . second experiment, five^ and eight^year olds were equated for 
performing at a level not beyond Model 1. Then Jfjeyvwere, provided wfth experience 
on either dislance or contlict problems, or with one ot two control procedures. 
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b^tWKe problem experience focused on the type of problems solvable by Rule II but 
not by^^e I; it ?hus was geared one step above the learners'" initial leveL^Conflict 
problerih experierKe, en^phasizine problems not understood even qualitatively until Rule 
III, WTO intended to be two or more steps advanced Accprding to Plagetian theorj^, 
the fit between a child's existing Kno^lidedge and the new information presented is b 
Critical determinant of when, how much, and what kind of learning will otecyr \ 
(Piaget, 1971). Support for this view has been foundry Turiel (1966) and Bla^tT^ 
(1971) in the area of moral development, and jay Kuhn (1972) (n class-inclusion 
tratnirkg. Therefore, we predicted that our ModeL I children would benefit from 
distance problems, while tfiey lyould learn tittle, if anything, from conflict problems. 



As^we already 'noted, there is nothing ^rtxthe models that would predict 
differential responsivit^ to instruction , of older andx^'ounger children. But both 
jntuit[on and empirical evtdcnc^ 'supp&rt-the. notjpri^t^ait older children arc more 
adept than youpger ones at mastering many novel :[^G^^tems on which task-specific' 
knowledge i$ equally lacking (cT. Siegter^ft Uefcert, 1974,1^^ Siegter, 1975). Thus 




we had no tiear grounds ^m-whkh to base a prediction abOL 
response to our training sequences, ^ , * 



age diffet'ences lt\ 



Method 



Eicperiment 2. included. three "segments: pretest, experienced and^posttest. 




Pretest . The pfetest consisted df^eight items: two weight, two distance, two 
conflict-weight, and two conflict-distance. TheMasks and apparatus were similar to 
those used in the posttest ib Experiment Ij^on e^ich trial, the child was shown' a 
ronfigbration and asKed to predict which of the three possibl^outcomps would occur if 
^ the wood bloctts were removed. There was no feedback during the pretest. 

. Eyperience , All experiential conditions except the ^bias control (see belcw) 
^ included 16 trials t>n which children WMe presented a randornized sequence of various 
types of balance scale problems. Children-we^e asked to predict what would happen 
and why they thought so^lfhen the wood blo«ks supporting the scale were removed so 
" that the prediction \^9s confirm^id or disconfirmed. After a 10 second interval the 
weights were rem(^ved and placed on the scifle in a different arrangement. 

ponflict problem experience involved presentation of !5 conflict-weight, 6 
Conflict-distance, 1 ^distance, '2 balance, and 1 weight problem. - Distance problem 
experience included 12 distance, 2 balance, and 2 weight problems. Thus, each 
*^j<pet ieritial condition included ^ probletns of the type being emphasizedj the 
additional 4 problems of other types were intended to prevent children from acquiring 
strategies too narrowly suited to the demands of the majority of items. 

Within the control condition there were two sijb-groups; ffye exposure control 
and the bias control. The^ exposure condition was designed to control for the 
possibility that any experience with the balance scale could improve performance; 
chi(drcr> in this condition were presented a sequence composed of 14 weight and 2 
balance items that woutd famrliarrze them with the balance scale's workings bu^ would 
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not directly e^igender Knowledge of Models II orJIL Howeveft ttjis control procedure 
njiight itseti bias children to^ward a greater i^etiance on Moid^CjUian if they had been 
left untutored. The^efore^. a bias controt was included In which children simply 
received thie pretest and posttest. Wfthin exh age group^s control conditioni one-liajf 
of the children Were assigned to the eitposurk control and one-hatf to The bias control. 

Ordered, np-feedtfack p^esentatjorr 
of i4Jtems, 4 each of bafance» weighty SbtancS^iH^inflict-wfeig^^^ ahd,. 
: conflict-balance types* The |^rete^tooK.apptlM^at&ty^^ ejJf^^^^ce 2$ 

minutes, and fhe posttest. 15 minutes. Eight-yea^^d^ w^el^ven the thrM. p^l^/in 
succes^on; five-year-olds were given the pretest ^CM^^da)^ experieW^ and 

posttest in a second session within the next fl8 hours. N 



f Part icibants. Pretests were given to 109 children, 56 kinafer^rteners (five- 
)^r-oldS;) and 5a third grJiders (eight -year -olds), attending \a middle aa§s school in 
^..^WK^ban Pittsburgh^^ To equate the initial .Kno>ii^ledge of pariidpants, jchit^n whose 
^ respe!i:)^s wj&re consistent with the distance cue on both distance tasks or on more 
than two^4J'^6 six distance and conflict items were excluded from further participallon 
tn the.expenf^nt. This eliminated 21 children— 1 male and I female five*year^olqs, 8 
male and 11 female eight *-y ear-olds. An additional 28 chi|dran-*17 female and 7 ma|^ 
five^ear-olds, and female eight -year-olds —were excluded randomly frorh 
experiential and^posttest phases in order to equate and sex charat^teristlcs of the 
age and treatment groups. ^ These children differed ini^ systematic way from their 
^ peers who dtd participate/ Finally, the remaining 60 children, 30 ffve-year-olds and 3 
eight-year-olds, were randomly assigned withm age and sex tq^ the three treatment 
groups. All groups had equal numbers of males and females except fo^r the eight-year 
otd'control group that included ^9 boy« and 6 girls. The mean.CA of kindergarteners 
-was 70 months Crange = 66-75 months), while the mean-CA ofHhird graders was 106 
months (range « 101-117 months); The experimenter^ ^ 22-year^d female research 



assistant,served fo< all children. 



Results 



Responses to the 24 item posttest were classified according to a scheme similar 
to the one used in Experiment 1. (There Were no differences betweenjhe two control 
groups, so all control data has been^aggrega^ted over Wf^^ them). As s^Own in Table 
5, Ab of tf>e-60 children behaved according W the models: 21 using Model I, 17 using 
Mpdet II, and 7 using ^Modet Ilf. A Chi Square Test indicated that significarrt differences 
werd present in the type of jules used by children in the six age by^experipnce 



p^fMp^ (X2 -45:54, df = It p^< ^OlK^ More^pecific analyses revealed that five-year- 
olds more o>ten used Model I and eight-year-olds j)iore often Models II or HI {X2 » 
12.91, df - l,p < .<X)1), and that children exposed to the tontrol procedure more often 
used Mo'del Jjwhile those exposed to conflict or to distance problems more often used 
Model II or III (X2 » 13.20i df - Vp < .001), 



An interactive relationship between type of experience ^ and age wa^ also 
apparent. Fisher Ex^c\ tests indica'ted thai among five-year*olds, experii^nce^with 
distance problems led to more adoptions of Modets II and lit than did experience with 
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>roblenife-Or the control conditions (p < ,01), As can be seen in Table 5, the 
s^ffect was ajmc^st exclusively to promote attainment of Model II; no condition \^^f\o 
m^y children attaining Model IIL ' Among the eight-year-olds, however,. both dist^ince 
anotxontlict^roblem experience led to more adoptions of Modols II and III than did the 
confrol prOce<Uires (p < ,001) ar1fd;xonflicf problem experience led to greater use of 
thart^ld the distance probl^s and control con'dltions (p < ,01)- 





Table 5 at>out^re 




Ih\$ummary then, Table-5— sbows-ur^hat both age groups can learn from 
training that is only one\ level beyond their current level (t.e,, distance training). 
However^ tivcn training -that is two levels beyOnd,(i,e, conflict training), the 5-year-old 
children laarned nothing, while the 8-year-olds benefitted substantially* Thus It Is 
clear that \ older and younger children derived different ■ lessons from the same 
>xp$rlence,leven when theyAhad identical initial predictive Knowtedge at>out the task. 



Revised Reprdbentations for Balance Scale Knowledge ■ ^ * ^ ' 

These empirical r«^tts raise questions that -reveal some of the limitations of 
the decision tree representation ^used,thusfar to represent chitdren^s Knowledge of 
bi^lance scale fasKs, Since the four models purport to represent alt of what a child 
knows about the task, they predict that children classified accordinj^ to one of Jhe'^ 
models should be identical on all task related performance, irftcluding learning 
about the task, Thus, they predict that the differential responsiveness to 
.experience with conflict problems that we^feserved between 5's and 8's should not 
\ave Occurred, Of. course, the jnodets make, this prediction by default,since . they 
no represenlf^Ton of the learning process as such. That is, they contain no 
re premeditation of the way that positive and negq^e information obtained durihg the. 
training sBcmence is treated, nor about the ways in which the models might undergo 
,transformatiOTHcpm one leStel ttr^o next. 

Another limitation of the representation is that H allows no way to describe 
the many different me^r^ utilized by Our subjects to arrive at the same end* We have 
already alluded to this in our discussion of the Model III explanations data, and now it 
is time to address it directly, 

We-need a representation that can accOiJnt for not Only the logical form of the 
decision rules used to make predictions, but also the psychological properties of the 
rules. That is, we need a representation that^enabtes us to. clearly indicate , the 
perceptual and mnemonic demands of actually using the decision rules. In this section 
we will introduce such a representation for childrens^ Knowledge about this task, and 
we will present example^ of the kinds of questions' the representation enables us to 
ask. Then, irt the next section, we will describe an experiment that prOvide;5 ^Ome 
answers to these questions. . v 
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A Production svstgfr> representation - ^ 

In, Figure 2 we have restated ll^^i^ four models of Figure 1 as productiprr 
systems (see Ivtewcll, 1973 for an extensive introduction, and Kbbr^ 1976b, for somte 
examples from cognitive development) A 'production system consists of a set o^ rules ^ 
^lled productions - written in the form of condition - action pairs, the conditions are 
fsymbolic expressions for elements of knowledge that mighj^be present at some instant. 
A^production system operates via a recognize - act cycle. During the recognition 
cy^le* atl the condition sides of all the productions are compared with the current 
contents of the' knowledge state. The knowledge state c&n be viewed a^hort term 
mcmwy, or the currently activated portion of long term memory, or /simply as the 
currcnXstate of awareness of the system. The productions whose conditions are 
true of\he knowledge state are placed into the conflict set, a conflict resolution 
principle is\applied» and one production fires. The act cycle executes the actions 
that arj^ as^^ciated witti the fired production. Then the next ^recognition cycle 
commences, \ 

* 

Thus the condily^ns arc tests on the moomentary state of short term jncmory 
(STM). a sequence of corldition elements on the left sidetof a production is Interpreted 
as a test for^the simultaneous existence of the conjunction of the individual 
knowledge elements. ^ tf^ f6r a given production^ alt the condition elements happen 
to be frue at some instant^ we say that the production is. **satisfied". If only one 
production is satisfied, then it "fires": the actions associated with It, written to the 
right of the arrow (see Figure 2) arc taken,*These actions can modify the knowledge 
state by adding, deleting^ or changing existing elements in it, or they ^n correspond 
to interactions with the environment - either perceptual or motor 

li tnore' tban one production is satisfied Bt a given moment, then the system 
needs to invoke some conflict resoiutibn principle* In the systems shown here atl 
conflicts are assumed to be resolved such that special cases have priority over 
general case?. For example^ suppose that the tWo productions in the cQnflict set are: 

^ , ^ pmU a b "> c d) 
P,TWO:(b '-> f g). 



P,ONE is a special case of PJWO, since P.TWO is satisfied whenever element *V is ir* 
the hr^owledge state^ but P,ONE is only satisfied if "b" plus additional information - in 
this case V* - is also in the knowledge slate. Thus, RONE will be chosen to fire, 
P.TWO will fire only when b, but not a^ is true of the knowledge state, (Extensive 
discussions of production systems can be found in Newell, 1972, Newell & McDermott, 
and Rychener, 1976). 



Figure 2 about here 



Consider^ for example^ Model II in Figure 2. Uti^ a production system consisting 
of three productions. The ej^ndition elements in this system are all tests for sameness 
Or Sdiffercnce in weight br distance. The actions all refer to behavioral responses. 



10 




Children's KnOwffedge draft 4 15 

\ 

^-p:^^ of the models m Figure 2 cOntafh a representation for any finer rtain knowledge, 
such -as the actual am'tetunt of weight or distancej or the means used |o encode thai 
Jnformation* tsior is there any explicit representation of how the system actually 
'Ixroduces the final verbaKputput. It is srmply assumed that the system has access 
td encoded representations ot^ the relation|H information stated in the conditions. We 
\wi)l return below to further coH^deration of the way that this information becomes 
available to the system. ReturnmgHo Model lit notice that on any recognize cyclej only 
One production will fire. If the weighls ar& unequal* tlien P2 will firef if the weights 
are equal and the distances are notjhen^tipth PI and P3 will be satisfied» but since P3 
is a special case of PI* the conflict resolutfbo principle will choose P3 to fire; finally, if 
both'Veights and distances are equal, then omyPl will be satisfied and it will Fire, 

The production system verisions of the oth^ three models are also shown in 
Figure 2. [The numbers altacheci^ to the^ productions (eg^ PI, P2, etc.) are not 
supposed to have any psychological hneaning. They serve srmply as labels For the 
reader; note that a production maintains its label.acrosslhe four models.] 

Wft can compare the four ^notlefT to de^rmihe the task facing a transition 
model. At the levet of productions the 'requisite modifications^ are straighlfoward: 
a transition from Motlel I to Model II requires the addition of P3; from II to III, the 
addition of P4 and P5; and from III to IV, the addition of P6 and P7, and^ tha 
. modiftcation of P4 t<r P4A (this modification changes the action side from random 
muddling through to "get, torque**). 

V 

We can compare the four models at a fiper tevet of analysis by looking at the 
implicit requirements for encoding and Comparing the important quantities in the 
environment. Model I tests for samer^ss or difference in weight. Thus it requires 
an encoding process that eitlxer directly encodes relative weight, or encodes an 
a&solute amount of each and then inputs those representations into a comparison 
process, Whatever the form of the comparison process, it must be able to produce 
not Only a same-or-dtfferfent symbolj but if there is a difterencej it must be able to 
keep track of which side is greater Model II required the additional capacity to 
make these decisions about distance as wetl as weight. This might constitute a 
compl&tely separate encoding and comparison system for distance 
representations^ Or it might bo the $ame system except for thd interface with the 
environment. 

'f ' ^ 

Model III needs no additional operators at this leveL Thus it differs from II 
"bnly in the way it utilizes information that is already accessible to Model IL Model 
^ IV requires a much more powerful sel of quantitative operators than M\y of the 

preceding models. In order to determine relative torquej it must first determine the 
absolute lorque on each $tde of the scate^ and Ihis in turn requires exact numerical 
J representation of weight and distance. In addition» the torque computation would 
require access to the necessary arilhmelic production systems to actually d6 the sum 
of products calculations. . 

Although we have compared the four hK>dels at' two distinct levels - 
productions and operators jhe levels are not really that easily separated. Missing 
from these models are a set of productions which would indicate the 

J? 
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interdependftnce: productions that explicitly determine which encoding the system 
^Vill make* That is, in these models, there are almost no productions oTf tha form: (wpnt 
to compare weights) (attend to stimulus and notjce weight). The sole eyceptiOnflto 
this occuro in P4A in Model !V, When this model is confronted with ^ non-confict 

if 

It is a conflict problem^ then P4A fires^ and the system attempts to "get torq;ie^ 
The result ot this unmo^&ted action, as described above» would be to prod^v<^ a 
knowledge element that could.$atis(y either P6 or'P7 on the next recognize cycle* 



Evaluation of the Production System Representation | 

Each of the four production system models in figure 2 makes precisely (he Same 
prediction as its counterpart in the ^ecisior^' tre^ representation of^Figure 1, Thui, on 
the first of the evaluative criteria listed above — accounting for behavior "m*ths 
production system modeLfares as welj as the decision tree model With respect* tf tne 
second criterion — multiple level analysis and the fourth • — dovelopnjpntat 
tractability — the produjction systems 1iave some advantages over the decision Fees* 
They make explicit the requirements for both the encoding operations and theflrules 
((,e* productions) that utilize .the symbolic elements produced by^the .operatOrsff They 
also clar^ify the developmental Uifferences between models in terms of these twy kinds 
^pf entitjes;_Allhough the production systems in Figure 2 are modaWorrrts^ Ive will 
demonstrate bolow th*"^fe*fe wifh which they can be recast in order to account for a 
single subrect^s performafice*^ ' . * .8 

The major advantage of the production system representation Iie3| In its 
-Jritegration of general psychologfcal priiHci(:)les the third of our evaluative Iriteria. 
P(60ductioTf systems of the type used here incorporate a theory of the conlrol 
structure and general representation that underlies a broad* range of human ploblem 
solving ability (Newell & SimOn, 1972), As Newell (1?73) puts it: \ 



-The -production system itself has become the carrier of the basic 
psychological assumptions.— the^system architecture of «,[the production 
systerrr] is taken to be the system ^architecture, of the human Information 
procpssrng system (516), 

Thus, models written in this form can be viewed as variants within a general 
psychological tbeory, and to the extent that such a general theory ts consistent with 
the empirical results ' from -experimental psychology^ -then these models, are also 
consistent with them, • , , = . 

With respect to the five questions listed^arlier^ the pn^^tion system's have 
enabled us to be very explicit about 01 (differences that' underliep^f/Ormance)^ and in 
particular about the important role of encoding operators. They have indicated some 
potential sources of variation for each level of performance (Q2)f aftt^ough 'since they 
ore writlen as modal types^ this^is tninely suggestive at this point. Similar comparisons 
of the relative eflicacy of the two lorms of representations for answering the" other 
three questions yield the same result. Thus, while the new repres^entation does not 
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provide much of an , advantage over the old fOr understanding the results of 
Experiment 2/it do^s provide some guidance about where to look for an explanation: In 
the encoding of the stimulus, ' - . , 

In order to model the conditions under ^hich one or another aspects of the 
stimulus are attended tQ and encoded^ we would need to nugmehl the njodels in 
Figure 2 wltl^producUo ns^Jike £4A. These productions woufd transform the models 
from simple- -JCjiGcriminalion nets^ into active problem solvers, and they would enable 
us lo make predicttons about such things' as eye-movements and solution latencies for 
different classes of ''^^otij3ms. However^ before we can make such^an exten^ion^ we 
must first determrnfe the vSrmiies of possible encoding schemes that subjects are 
actualj^ using. As a first step in tha1'"<tirectionp we undertook a detailed examination of 
"ttie problem by problem protocols of a f&w children in a training sequence. ^ , 



'- fipfrtocol analysis 

^"^.^^^ Several children, ranging in age from 5 to 10 years were unsyslematically 
selc^t&d^to b e ' run Individually In a conflict training sequence. They were given 

instructions about the balance scale and about Ihe fact that there were rules 
underlying the balance-scale's behavior that they could discover jf they "watched 
carefully and thought about it". In addition, following their prediction on each trials 
they were a^ked to state their 'r^easons for the prediction. Then the. blocks were 
removed, the children observed the scale's movement and if they were incorrect, they 

. were again asked "Why do you think that happenned?" 

These entirg sessions were video-taped, and then all the verbal coinments, as 
well *'as major physical activities were transcribed Into' the form shown In 
Appendix A, At Ihe beginning of each problem, there is an Indication of the 
probleni numl^er, fhe configuration, and the elapsed time <in minutes and seconds) 
since the start of the session. Problem numbers Tl, T3, etc., correspond to Items 
. from' the training sequence, and problem numbers E7, E8, etc, (see lines 11000^ and 
M^OO) are from an evploratory session which followed the training sequence. In 
the evploratory session, the children were encouraged to buitd interesting 
probfemGfOr to explain lo the experimenter what kinds of problems would achieve 
certain outcomes. The problem configuration is indicated by a numerical code that is a 
near-piclorial representation of the problem. In Tl {line 100) the code 0001/2000 
indicates one weight on Ihe hrot peg (from the fulcrum) on the left si(^o, and two 
weifthfs on the first peg on the right side. In T3 {lino 1900), th^ code 0100/1000 
indicates a single weight on the third peg on the left, and a single, weigtit on the 
first peg on the right, 

Evcerpis from the protocol of Anna, a five ydar old female, are shown In 
Appondiv A, The protocol provides a rich data source from which to select 
"ott5ervations*V However, in thi^ discussion we will , focus only on those aspects that 
indicate the kind ol encoding of distance and weight that Anna appears to use, 

Anna' was first given the standard iiislrtrctions and pretest described 
earlier, Hor rbsponse pattern did not coniform to any of the four models. However, If 
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Model I were modifie^ &uch that heavy things went instead of down, then she was 

a perfect Model I subject. The firs^ problem in the training sequence confirms this 

interpretation (lines lOQ - 1700). Anna Knows which side has more weight, but her 

prediction is based opon the assumption that more weight goes op* However, when ' 

confronted with the contrary ?vi*dencej^ she changes the "sign" of the correlation 

between weight and direction of trpping. This single feedback trial was sufficient: for 

the remainder^of this half hoor session^ she never again errs In her understanding ^ 

of the direction of the effect of weight differences. As we will see, tlie correct 

encoding of distance, and its effect required a much longer series of trials. ^ 

The . second training problem (not shown) was a balance problem, to T3 
(OlOO/lOOO) was the first instance in which Anna received feedback indicating that 
equality of^ weight is not ^ a reliable predictor. Her own verbalization of the* 
problem captures her puzzlement: ''Well why are they bot*l the same thing [same 
weight] and one's up and one's down?^"(tine 3000) 

Another distance problem followed immediately (t4! 0020/0020), and 
Anna's first response is to say balance, but she quickly corrects herself, having 
detected the distance difference. Her encoding of distance is correct in that it is 
based on the fulcrum, rather than the ehdpoints, as the zero reference point 
(tines 4100 - 4200). However she incorrectly associates greater distance- with the 
*$Jde that goes up rather than the opposite, in the same way that she initally had 
the sign« wrong for weight effects. This is her first attempt to utilize dIsfanCe 
information, and she'gets negative feedback. At this point slie might abandon distance 
as a useful cue, or she might - as she did with weight - simply change the sign of the ^ " 

relation. As we' will see, sfcie does neithfer* ^ 

T5 was a complex distance problem (OIOI/UOO), and T6 (0102/2010) a balance 
problem, niether one of which yielded a useful protocol. In fV» (0200/2000) we 
return to a distance problem. It is clear from the protocol that Anna is still 
attempting to use distance (lines 9000 - 10600). "^She still encodes direction of 
distance from the fulcrum correctly, but she has not changed her erronemjs 
assumption about the effect^ of this difference. Note also that she has not yet rr^e 
eny statement about absolute amount of distance^ all Her statements are ^out y 
relative distance. 

In Order to focus on the issue of distancGi encoding, we skip over about 15 
mtnutes of conflict training in which the problems were mainly complex conflict 
weight and conflict distance (i.e. two or more pegs occupied on each side) from which - * 

_ -*no-cJear -pattern emerged.\VVe -pick-tip the. protocol .ogain in an excerpt from the 
exploratory phase in whicli^*Anna was allowed to construct (Problems actofding to 
various experimenter requests or hints. In E7^lines 11000 - 1^100), stie has been 
asked to construct som^ problems such that she will not be quite sure what the result ^ 
will be. In general, Anna does no such 'thing, and instead tends to construct 
prObleniG about which she is very corfidentr' Thus, hc^r initial configuratiorf is 
OOO3/0004, a problem in which both weight and distance indicate that the right sida ^ 
will down* Then the experimenter modifies it to a distance problem (000^/0004)/ 
* and Anna apparently forgets all about distance differences,* reverting to a Model 1 
prediction of "balance" (Irnes 11700 - 13000). With a littte prompting from the 
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experimenter (lines 13200 " 13700), she invokes a (pofit hoc) distance explanation ^ 
(lines 13800 - 13900)* Notice that the distance description is not just a relative 
judgement, but instead is stated in terms of two absolute (albeit approximate) 
quantities. 

It eppears that, ev^ after almost 30 minutes of ex'perience with the balance 
scale, Anna Knows that distance Jis an important factor, but she has not yet 
developed a reliable rule about the effect of distance differences. Then, over the ; 
next two minute period^^she begins to demonstrate a stabilizing grasp of this concept. 
First she creates a balance problem and makes the correct prediction (lines 14^00 
- 15600), Then a new experimenter enters, and feigning ignorance, asks how 
the scale works. Anna creates (0003/0003) and predicts correctly, and for the right 
reasons (lines 16500 - 17400). then, at the experimenter"! request, she correctly 
creates a balance problem (0003/3000). It is interesting that she doe's this in the 
^'easiest" wny, given the configuration from which she was starting, but it is 
also the cace that this is the same balance configuration that was used in the 
preceding probfem. Then J^he creates a distance problem such that the scale tips 
fn a desirpd direction (18700 - 19100) and gives the correct explanation, and 
finally, she iniliates yet another balance problem, one unlike any she has ever seen 
before (9000/0003), ' . \ 

t * 

Recall thai this protocol analysis was undertaken after a discussion of the 
production system represcntatioo of knowledge atwut the balance scale (Figure 2), In 
that re^preseMation, we tried to emphasize' the differences between the encoding of 
inforn^ation about the environment (the undefined operators) and the combination 
rules [cf. Gelman*s (1972 a,b) operator-estimator dtstinction, and Klahr & Wallace, 
1973, operator-rule dichotomies],, for acting on that information (the productions), ' 
-T4ie protocols tell us something about the nature of the representations that are 
being Used by l^e child, and hence something about the errco^ing operators that 
produce them. It is clear that Anna extracts information from the training series that 
will enable her to improve both the encoding operators and the combination rules. 
With respect to wfeight, ^he +ias no difficulty In fcfrmulating an appropriate 
encoding based^on counting the number of weights. Although there is an initial 
error with resp^sjct to the*: relation between weight differences and the direction 
of the scale, this is^qulckly c<)rrected and remains stable for the rest of the session.^ 

Dictanc^ encoding follow? quite a different course. Initially it Is ignored. Then 
differences in distance are noted, but their effect Is quite uns^abto In the f^ce Qf' 
negativ<^ feedback, and as >mo saw, they are occasionally ignored well Into the 
training sequence* However, it appears that by the very end of the exploratory 
trials, inappropriate encoding of distance, and a concomitantly appropriate rule for 
utilizing it (at least on distance prcfblems) has been formulated « 

Learning about the balance scale then* would seem to require much more than 
is suggested by a comparison of adjacent models in Figure I, The production 
system representation of Figure 2 has enabled us to make explicW the difference ^^^ .^ 
between encoding operators and decision rules, and it has guided our search for 
instances of both of those kinds of learning in the protocol ^ The analysis 
suggested that there is a point in the development of knowledge afiout this task 
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during which the dimensions may be encoded in idiosyncratically incorrect 
ways» and that the form of the encoding may depend upon trial to trial feedback. In 
the next section we will introduce a model^ that attempts to. capture the^ 
phenomena for an individual subject, ■ , ^ 



Revised Production svslem for a Model III child 



Thusfarj Uio production syslgm representation has been used only to suggest 
some of the corvtplcKlties of learning about the tesK. In this section we wilj work 
toward the creation of a prodactforr system model of a single child^s behavior during 
a training sequence. The representation will be more than suggeslrve, for it will 
be specific enough to run as a computer simulation. The simulation will sefve two^ 
pqrposes, Fi^st, it will demonstrate iT^^e sufficiency of the mpdel to account for the 
data It purports to explain,- ^cond, the particular simulation language in which the 
model is stated is b^d upon» and incorporates in its structure* very specific 
assumptions about the nature of the human information processing system. Thus^ the 
model to be described here is 9 particular instance ^f a much broader, theory of 
human problem solving. ' * 

Our subject - Pam was a femate second'^raderj age 7 ye^Sjl l^months. Her 
performence on an 8-item pretest and a 'I6-item training serrtjrts shown in Table 6* 
In Table 6, each row corresponds to a problem. The columns indicate, respectively, 
problem number, problcrli configuration, prol^Tcm type (Distance, Balance, Conflict- 
Weight, Weightj etc*), Pam^s response (Lefl or Right down» Balance)j feedback from the 
scale (if the subject^s prediction was inconsistent with what the scale drt^, it is 
indicated by a '^*'), predictions from. three of the previously described models (IVj 
It, and W an<l finally, Iwo columns corresponding Jo the model to be described in 
this section. The first of these columns - 111-A - contains the model's prediction,- 
and the second contain^ the value of a variable criterion that is used to make the 
prediction. For example. Problem 7 has 3 weights on the first peg on the left and 2 
weights on the third peg on the^ght; it is a conflict-distance problem* Pam predicted 
that the left side would go down, but as Model IV (which is always correct) predicted^ 
the right side weni down so the subject got negative feedback The other tfiree 
models shown here <II, I, and III-A) all make the same prediction as the subject: left- 
dowri. The numf^crs at the bottom of the four model columns show the number of^ 
mismatchos between Pam's predictions and Ihe model^s. 

r . , - 



Table 6 about here 



Pam*s s responses lo the pre-test make her a perfect Ktode] 11 subject* Her 
responses during the training sequence provide a poor fit to models t» II» and IV. 
Recall that the criterion for fitting Model III was that the responses be essentially 
random for conflict problems* Thus» allhough fhe "muddle through^' prediction of Model 
[It does not maKe an exaci prediction on any trial, it predicts the absence of a 
consistent patlern over the set ef conflici projjiems* And indoodj this is wfiat we 
find in Table 6: on five of the eleven conflict problems Pam responds ao If she 



ERLC 



22 



Chttdren's Knowledge 



^ - 
drift 4 



21 



were relying on the weight cue, and On the other six, she conforms to the distance 
cue/ Thus, we could simply classif)^ Pam as a Model III subject and leave it atJhat. 

Such an interpretation has severe! deficiencies. First,^lhe classification scheme' 
itself is unsatisfactory when compared to the^pthers* Mo'det III subjects get so 
classified as a residual category - by the, absence of ajny pattern in their'' responses 
to conflict probfems, whereas alf other classification is based on the Occurrence of 
things that were predicted to happen, rather than the absence of things that 
should not. In addition to this "taxonomic"* weakness, Model HPs "muddle through" j 
prediction tells us nothing about the psychologieal processes that actually * 
operate when subje^cts detect conflict but do not yet know how to deal with it 
correctly. We have already cited some of th^ idiosyncratic strategies that different 
subjects bring to bear On this situation. Finally, ft is important to emphasize that 
Table 6 represents responses during a training sequence, a situation in which the 
child Was presumably attempting to integrate the feedback from the balance-scale's 
actually behavior with her current hypothesis aboul how it worked None of the four 
irpodels described thusfar have ^ny mechanism to represent ^nd utilize such 
information. Thus, the model to be described represents first steps in remedying 
these deficiencies. 

Pam was run under the same conditions as Anna, and an analysis of her trial by 
trial explanations Tarovided the initial evidence for the model that we eventually 
form ulated. TKe mosl striking feature of her comments was. the Way* she appeared 
to represent distance and weight on conflict problems. Both of them were treated as 
dichotOmOus: mOrp than two weights was treated as "big", otherwt^^ weight was 
"little", and if the third Or fourl^ peg were Occupied, then distanli^^jiaj^ "big", 
otherwise it was ^litl)e'\ Rather than present another tengthy protocol analysis here* 
we vifl show just two examples of this dichotomous encoding of distance. 

On prQiplem ^2 (0013/1020), the child predicts left downj upon seeing the resUlt, 
she says; - 

■ . ^ y 

Q^, r^ow I think I know why.... I think I know becaijse,.,. tt*s supposed 
^ to Mm a rule that they usually go down more if theyVe on that, 
sitJbi^ipointing to the extreme right of the balanoo scale). So tKat one 
weM down cause it's 2 there (poin^ting far right) and'none there 
(p^ntiiig far left). 

If we ehcode each arm of the balance scale into a near segment (pegs 1 and 2) and 
» far segment* (pegs 3 and fl), then this protocol is easlfy interpreted. "They 
usual|y_ go down more if iheyVe on 4h6t «ide" means that If the far segment is 
Occupied (**big distance*') then fhe scale will tip in that direction. *TwO there and 
none there'* means that the far segment on the right is Occupied by two Weights, 
whereas the far segment On the left is unoccupied 

The second example cOmes from problem 14 (0200/1300), just before the 
child geH feedback. She says: 

This side's gonna go dpwn (pointing left)... Even though this one has 
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(pointing right) - and this one only ha? 2 (pointing left),.. Even 
though this one has {pointing right) twice as much as this (pointing 
left), that means that because this one's more [waves to far left] over, 
and that's (pointing right) all on th^ side. 

In this case, we garner support lor the dichotomous distance encoding from the 
comment that the weights* on the right arm of the scale are *'atl on that side", "That 
' side" of what? By odr interpetation, they are on "that side** of the mid-point of the 
right arm, thus making distance **litlle**, ralher than "big" on the right. 

In order to determine whelher this interpretation of the protocols is valid, we 
nepd to construct a model that is consisteni with Pam*s actual predictions on each trial, 
as well as her explanMions. Based upon many ^ such comments and our 
interpretalions of them, ^ constructed the, model whose^ predictions are shown in 
Table 6, )n order to provide a clear overview of the m6de1 we will describe tt first 
In terms of a binary decision tree, plus a few ad hoc mechanisms. Then we will 
present a running produclion syslem for. a more complete model basfed on the same 
underlying logic. 

Figtre 3 shbws the binary decision tree representation for Model lII-Ai Pam's 
performance on the training sequence is shown in Table 6. The numbers under the 
terminal nodes correspond to thd problem^ from Tabia 6 that are sorted to thoM 
nodes. The first three tesis are Ihe same as (hose in Model III (Figure 1), and theX 
^ account for balance, weight and distance problems. If neither weight nor di^A^ncy 
is **same", Ihen the model begins to test for "big" values. If either weight or 
distance - but not both - i^ big, then the side with the big value determines the 
prediclion. If bolh are big, Ihen Model Ul-A favors whichever one Is currently its^ 
criterion value. The 'criterion value slarls as weight, but whenever negative feedback 
is received Ihe criterion switches from one value to the ojhcr. The state of the 
criterion value is indicated in the lasi column in Table 6. Note that it changes after 
any negalive feedback^ nol just on conflict trials with negative feedback. (The 
terminal node labeled in Figure 3 is never reached by the set of problems In Table 
16. Such a problem would be. a conllict problem wilh neither weight nor distance 
"big". Wfr have no evidence upon which to base a prediction about what Ihe subject 
would do with such a problem.) 



Figure 3 about here 



. A^_£f:Pduction sVstem for Pam (Model III-A) 

The produclion system for Pam is shown In Figure 4, The representation 
contains the actual computer tisJing Wilh a few inessential detaijfi^ot shown) for the 
production system^ which is written in a special language called PSG (Newell ft 
McDermptt, 1974). Appendix B contains a trace of this model running on a sequence ol 
four problems from Table 6i one of them - Problem 5 - fs also shown In Figure 5. 
Before wo embark on a detailed doscriplion of the models we will make a few 
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coltiments about the properties of this rather detailed representation for knowledge 
about the balance scale task * 



I Figure A about here 



The model enables us to represent explicitly all task relevant knowledge In 
a homogeneous and integrated manner This model utilizes^ in One way or another^ 
representations of knowledge about; 

which side has more weight or distance, 
' which side has a big weight or distance, 
what the current criterion value isj 
what the scale was expecled to do» 
what the scale actually did, 

Whether the prediction was correct or incorrect. ^ - ' , . 

The model cohtains rules for when and how to encode the environment* It also 
Indicates the number and nature of pieces of information to which the subject mu^t 
be ri^spOnsive during the course of the experiment. 



Production system inlernretatiOn 



Some general properties of production systems were described earlier. In this 
section we wilf add a few more details about how the model in Figure 4 Operates. 
Recall that the basrt cycle for a production system W recognize-act. During a 
recognition cycle, all the producttons compare their condition elements with an Ordered 
list of Elements in STM (short t<Jrm memory). The trace !» Figure 5 shows the state of 
STM after each cycle. For example at ithe beginning of the second cycle in Figure* 5^ 
we see that STM has 4 elements in it: VdST MORE RIGHT), <WGT MORE LEFT), <PRED)^ 
^ancJ {CRITERION WGT). An ekaminatiOn qj the productions in Figure 4 reveals that the 
PI Is Only production ^whose condition elements are completely matched by STM 
elemenls^ so^in this case, it fires {i-e.^ it is "TRUE" jn Fig. 5)* We can Interpret a 
produclron, P:(A B C — > 0 E), as ''If you knOw A and Brand C <l.e. if they are currently 
in STM)» then do actions D and E. , - v ' ^ 

There are two conflict resolution principles. The first One to be applied V 
special case Order - has already been described. If» after applying special case Order, 
there are strll two Or more productions in the conflict set,then a second resolution 
principle - STM order - is applied. This principle- ct^oo^es the productions ^yifh the 
frontmost element in STM. New information always enters the "front" of STM, pushing 
alt else down a "notth^ Furthermore, when a production fir^s, fl$ evoKing elements 
are*mOved to Ihc front Of STM (automatic reh^jarsal). Thus the STM Order conflict 
resolution principle says, in effect, "when in doubt, respond to th6 "mosi recently 
imbortant* information/' <ln Figure 5, ^d Appcndin B,spccial case order Is usually 
adequate to resolve conflicts. All instances where STM'^order Is also os^d are 
explicitly indicated in the traceV 
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There are several different types of actions. ») STM additions, Th^e 

simply add new elements to the front of STM, For exarhple^ if E3 fired, (result wrong> 
would be acJded to the front of ^TM ' Other source's of new information, are the 
encoding operators (described below).. 

rf^^ STM modifications. Elements in STM can be* altered directly. The 
action (A »f=»> B) changes symbol A to symbol B in tl^ second element in^STM The 
action (X **) changes the first element In STM from a to (X (a)), 'rom (DOG> lo 
(OLD (OOP)) J O ^ 

> c)- Output. These action^ are surrogates for action on (he external 
envif'onment, The'o^nly one^s used here are saytb (say **balance**) an^ say.d (say left or^ 
right doy/nX ^ , ' > 



Description of model (Fig. 4> ' V( 

There are three major functional groups of productions. 

1> Pn- These correspond to the. major, n^des in Ihe docisFon 
tree representation. PI - P4 are essehtially iha same as PI -P4 In 
-Rgure 2, P5,Pf,P7 correspond to the tests for B\g things in Figure 3, 
Some of the productions use variables, that can be matched by specific 
values in STM elements. For example, 01 and 02 can bo matched by 
either WGT or DST, while X] and X2 can be matched by anything. 

2) En. These contrDi the model'^ viewing of the balance, scale, 
after it tipc, and compare what it expected to see with what it actually^ 
sees. 4 

3) SWn- These change the criterion whenever '^he system 
deter rt^ines (via the E productions) that it' has made an Incorrect 
prediction. 



There are three encoding operators. None are ^modeled, but their 
conditions of evocation are explicit, as is the form of. « the encoding Ihoy produce. 

* - * 

DAttend. Does initial encoding of weight and distance. Thit 
operator can detect sameness or difTeronce of weight or distance and 
cah indicate the side on which weight or, distance is greater. Thus, It ts 
only an encoding pf , relative quantity. The Model, assumes that Irf the 
first instance this is all that is encoded. * 

2) Find.big. Encodes big wgt or dst andiside^ on which they 'occur 
(If lheyH>ccur). ' , 

3) LOok. Ehcodes direction oE^^tipping of scale. 



Children 5 Knowledge draft 4 ^ 25 

I3yriamic$ of the modeK ^ 

Tt)^general procedure is as follows. First weight and distance dif ferences, if 
any> are encocted , If there is no conflict^ then a prediction is made, an expectation is 
formed^ and the scalers actual behavior is observed. If ft is inconsistent with the 
prediction, then the criterion is changed, tf initial encoding reveals no clear prediction, 
then a second encoding effected, this time in terms of big distance or weight. Then 
the rest of the process follows exactly as in the case of a single erkoding. 

Rgure 5 contains a trace of the model working on one of the. problems from 
Appendix B, the trace shows the state of STM at the start of each cycte, as welt as 
which production fired, Cohflicls are shown when they occur, a$ are the results of the 
encoding operators. , . ^ 

The system starts wit^h an element in $tK4 <PRED) indicating that it has a goal of 
making a oredictton, and another element representing the cui^rent value of the 
criterion. Since there is no element representing Aveight or distance, the only . 
production whose conditions are completely satisfied ts PSf'which tests for (PRED) ai^d 
the absence <ABS) of a weight or distance element (Dl), ATTENp, P8's only action. Is 
an encoding operator that is modelled only «p to the point of its input/output 
specifications, jn^ this case the input is presumed to be the physical arrangement of 
disks on pegs^in the configuration (0003/0020), and the outputs, as shown in the trace, 
are two comparative symbols indicating more, weight on the left and more distance on 
the right. They are directly provided by Ihe model buildeit, 

Thus, at the .j^eginning of Cycle 2, STM contains four elements, and these 
elements satisfy both PA and P2 (see Fig. 4X P4 is a special case of P2, so it fires. It 
recogniiscs that^. neither weight nor distance are equal, so it attempts a second 
encoding ( FIND, BIG) 1o determine some absolute amounts of distance and/or weight. 
Once 'again, an unmooelted encoding ^operator is assumed to produce two elements, 
indicating a big distance on the right and a big weight on the left. The results are 
shown at the start of the third cycle. 

Five production^ are satisfied by the elements i^pw in STM, P2 and P4 are stilt 
satisfied since none of the elements that satisfied them on the previous cycje have 
been changed. P% P6, and P7 are satisfied because they test for either big weight or 
big distance. Since P4 is a s^pecial case of P2 and P5 of P6 an^7 the special case 
order principle leaves P4 and P5 in the conflict set, Bot the elements that match P5 
are newer than those that malch P4, so STM order selects P5 to fire/ 

P5 matches whatever the current value of the criterion is (in this case weight) 
with the corresponding "big" element [in this case (WGT BIG LEFT)]' and then uses the 
value of the directional variable (lEFT) to form its expectation (€XCEPT LEFT DOWN) 
3Tid to **sayi*jts prediction.. , . . ^ ? 

■ ■ Nr „ : " " ' 

What the system knows at Ihis particular moment is' revealed by the contents of 
STM at the start of the fourlh cycle. It knows that: 

It expects the left sido to go down {EXPECT LEFT DOWN) 
It already made a prediction {k4ADE (PRED)) 

. The current criterion is weight (CRITEfllON WGT) 
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And U knows the encodings (WGT BIG LEFT) 

( {DST BIG RIGHT) 
. (WGT MORE LEFT) 
(DST MORE RIGHT)' 

f The rfest of the trace is straightforward During pass 4, the system seeks an encoding 
of what the sc^le actual/ did, and it sees that the right side went down. On pass 5 it 
-recognizes that what it saw is discrepant with what it expected {ES\ so it j^nows that 
it got the problem wrong* Finally^ on the 6th pass, it /ecognizes that it was wrong 
while using the weight criterion^ so it changes it to distance. 

Evaluation of Representation's for Pam's Knowledge ^ % 

The decision tree. in Figure 3 and the production system in Figure 4 are logically 
equivalent: both account for alf bdt the last of Pam*s predictions during the training 
serie;?. As described above, they differ from the representations of Figure 1 and 2 in 
that they model the subject^s response to feedback, and because they both represent 
idiosyncratic' encodings of fhe stimulus. Thus both models have certain advantages 
Over the previous ones, 

\ However, the models are not equivalent in ell respects, and the psychological 
properties of the production system - properties previously just alluded to ^ can now 

— be clarified The production system, since it embodies a genera) model of the human 
infortnation processing^^sy^tem, forces us to be very explicit about things that the 
decision tree lets us finesse. There is no separation of control information from data 

' in a production system. Every relevant piece of information is explicitly represented 
Jn STM, ahd all task-specific knowledge for acting ofi that information is represented 
by "productions. As indicated by the final list of elements in STM* we are postulating a 
remarkable amount of material floating around in STM, However, once we attempt to 
model the momentary states of knowledge for this sort of task, it becomes logically 
unavoidable to consider at least as much as this, [t is hOt^lear that a ^stem that did 
not know all of these things could ever to the task Such requirements are hidden in 
the decision tree representation. Thus it is difficult, in evaluating a decision tree 
representation, to ~be sure just how plaustbtb the model is with respect to the 
psychological demands it might impose en the organism. 

For all their empfia^is on the importance of the outputs from the encoding 
operators however, the production system modets do not describe the encoding 
process itself. Neither do they indicate precisely what sort of encoding deficit might 
affect response to instruction, A remedy to the ikirmer limitations woutd take the form 
*of a model of encoding, and we teave'that for future investigation. The second issue, 
that oi the nature and effect of encoding deficits, is directly related to Q4 and Q5 of 
our initial set. In the t^ird experiment in this' series, we investigated these i&sues. 
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Experiment 3; The EncOdinB^Hypolhesis 

Recall that the results of Experiments indicated that older J^nd younger 
chtldren* equated for initial task specific knowledge about the balance $cale» 
responded quite differently to the training sequences. This finding motivated a shift 
in tHe^ representation and in the level - Or grain - of our analysis of what was going on 
during training. ^Anna's protocol analysis revealed her difficulty in determining 
tne appropriate encoding of the two relevant dimensions^ and the analysts of Pam> 
responses during training ted to a production system which incorporated two 
levels of encoding - One relative, One absolute (big/nOt big) - for both 
^dimensions. Similarly fine-grained analysis of other .protocols revealed many such 
stimtltus misencodings. This suggested to us that otfferentiat encoding might be the 
cause of the differential responsiveness to instruction. 

However, in order to convincingly test this hypothesis, seVeri) steps are 
necessary. First we musi assess - encoding independently of predictive 
performance. Then we must show that the appropriate manipulation can eliminate 
or at least reduce encoding differences. Finally we must demonstrate that when the 
difference On the explanatory variable - encoding - is eliminated^ the initially 
observed difference On the to-be-explained variable - responsiveness to instruction - 
is also eliminated. In summary then, our goal is to show that in a group of older and 
your^ger children who are all using Model I inittallyj there is a consistent encoding 
deficit in ~ the younger childrenj then to eliminate this deficit, and finatly to expose 
both groups to the training sequence and to produce identical learning in both age 
groups. 

Attempting to do this at the fine-grained (eve) of the preceding section 
would lead to a mass of detailed variation that would be likely to obscure the 
general properties of encoding differences; it would also be prohibitively expensive 
in terms of time and effort. Therefore, in this sectiiDn» we move back up to the 
aggregate level of grouped d^a. 



The reconstruction paradiRm. 

Chase and Sirifon (1973) utilized a reconstruction paradigm in order to. study 
the differentiaUabiliiy of chess masters and nOn-masters to ^ extract meaningful 
information from briefly presented board configurations. This procedure suggested 
to us a means by which differences between "oWer and younger children's 
. ^^ncoding of balance_scale configurations could be assessed independent of 
; Jth0ir predictions ^ibOut Jhe eff^t of thesiB:?toh1igyratipns 6n-the scale's behavior. 

In the third experiment in this series, five- and eight -year -old children 
were presented with, various configurations of weights on a balance scale for a few 
Seconds (the c;cate was not free to tip). Then the scale was removed from view* and 
they were required to reconstruct as accurately as possible the initial configuration on 
an empty scale. Note that this procedure allowed independent assessment of 
encoding On. both weight and distance dimensions. For example^when given an Initial 
configuration (0300/0200) the child might *Y6construct 4t as (03C0/0200), or 
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(0030/2000), or (0200/0100) br (0010/0003), revealing , respectively, nO 
miserKioding, distance Only misencoding, weight Only misencoding, or both weight and 
distance misdncodings. Our protocol analyses led us to expect that the older children 
would be accurate On both dimensions, while the younger children would do well 
on weight, but poorly On distance. 

Basic Procedure. The same basic procedure was followed in alt phases of 
Experiment 3, and the full details are given in Siegler (197&b). Here we will Only 
describe the major features. Overall, 40 iMndergartners ("tive-year-olds") and 30 
third-graders ("eight-year-olds") from two public schools in Pittsburgh participated in 
Experiment 3,^ 

Two identical balance scales were used They were slightly different from the 
One used previously, having 7^ rather than 4, pegs on each side of the fulcrum, and 
haying a built-in lever, rather than wood blocks, to keep the scale from tipping until 
ihe experimenter released it^ A large styrofoam board Used to hide One of the 
balance scales during the reconstruction phases. 

The encoding test included 16 problems, on each of which there were from 
3 to 5 weights on each side, all located on either the thirds fourth or fifth peg 
from the fulcrum. On any given problem, Only one peg On each side was occupied. 

Children were tested individually in a vacant room in their'schoot. Each child 
was presented with the encoding test first, and then presented with the same 24 
item predictions task (withoul feedback) used in the Experiment 2 posttest. For the 
encoding test, the children were told: 

The idea of the first game is for you to look how the weights 
are set on the pegs On my balance scale and then make the same 
problem by putting the weights On the pegs on yOurs. First Vtt put 
the weights On the pegs On my scale. You should watch closely to 
see how the weights are set on the pegs. Then Til put the styrofoam 
board back up $0 you can't see my scale. You will then need to put 
the weights On the pegs on your ^ale in the same wa/ that you saw 
them On my scale. Just put the weights on the pegs sO jt^'s just like the 
problem you saw on scale. 

After the first trial, children were again told, **Remember, you should watch 
clooely^to ijaee. how the weights are- On the pegs on mV scale so that you can put the 
-Wights on your scale in the same way/* Children were .allowed 10 secOhds. lo 
observe the initial configurations, and then they were allowed to reconstruct 
the arrangement immediately On the other scale. There ^vas no lime limit for 
reconstruction, although children Usually finished quickly. 

Following the last encoding trial, children were told that they were to play 
another game^ and instructions similar to the previous predictions trials were 
given. The encoding and predictions tasks were given in a single session lasting about 
25 minutes. 
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There were several variations on this basic procedure. We will describe each 
variation and its results in 'sequence. The results from alt phases are shown (n 
t^iree forms. Table 7 shows the percentage of correct distance and weight 
encodings for bqth age groups. A strict criterion of perfect reconstruction of both, 
sides of the scale was used (or both weight and distance scoring. Table 8 shows the 
percentage of correct predictions for each type of problem, and Table 9 shows the 
classification by model type for each age group in each phase of Experiment 3. 

Experiment 3a. Ten cNldren from each age level participated in the experiment 
exactly as described above. As shown in Table 7^ the results were consistent with the 
encoding hypothesis. The younger children showed a great disparity between their 
'ability to reproduce weight perfectly and their ability to reproduce distance ^ while 
th^ ..older children did not show a significant difference b^ween their weight 
and distance reproductions. This pattern held for individual subjects in each age 
groupi and is not Ihe result of aggregating over subjects (see Siegier, 1976b, for 
extensive statistical analyses" of these results), f^fice that these encoding differences 
between older and younger children were not accompanied by a corresponding 
difffsrence in ^ability to predict how the balance scale would behave. As shown in 
Tables 8 apd 9* there was virtually no difference in the percentage of different 
types of problems passed or m the distribution of children using each model. 

( Experiment 3b, In this variant^ 10 (ive-year-olds were given 15 rather than 10 
seconds tO; view the inilial configuration during the encoding testst This was done to 
explore the possibility that the younger children were simply a bit slower "than the 
older Ones in encoding the configurations. If they were attempting to encode both 
dimensional and had a preferred noticing order of weight first*>ticr1^givi;0g. them more 
time would be expected to improve their distance scbre^. ^ shown in Table 7j this 
"insufficient time** explanation is unsupported by the results^ 

3c, Perhaps the younger children did not understand what 



was meant by/ "make the sUme problem". In this variant^-the children were told 
explicitl^ whaK to encode, and what constituted the experimenter's criterion for the 
"same** proBtem, Ten children of each age level participated,. The instructions for 
the encoding task were changed to Ihe following 

The idea of the first game is for you to look how the weights 
are set on the pegs on my balance scale and then to n^KQ the «ame * 
problem by puttingJhe weigMs^ on the pegs on'^ yours. You want It to 
* * 'bte Ihe same problem in two ways. You want the same number of 
weights on each side of your scale as I had on my scale, and you want 
the weights on each side of your scale to be the same distance from 
the center as they were on my scale,... 

* ' ' ^ 

Later in the instructions^ cNldren were again totd that they should *V;atch closely to 
see how the weights are set on pegs - how many there are on each side and how (ar 
from the center the weights on each side are." Finallyj at the end of the instructions^ 
children were asked to indicale the (wo ways their arrangements should be like 
the experimenter's. This was to ensure that they understood what they had been 
told. The few children who did not understand were again presented the 
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instructions and asked the identical question untit they could answer approprlalely. . 
In all other w?ys, Ihe procedure was the same as^ that used in Expermient 3b^ with a 
15 second viewing period. 

, * Once again^ as ' shown in Tables 7^ 8j and 9,Mhe results differed hardly at all 
from those of 3a and 3b* Telling children what to encode does not reduce the 
discrepancy between their encodin'g of weight end distance^ nor does it improve ' 
(heir performance on the predictions (ask 



Tabtes 8^ and 9 about here 



Experiment 3d. This time, children were told not only what to encode^ but also 
tiow to encode it. If the problem lay in the Inability of the younger children to 
correctly encode distance^ or to handle two dimensions simultaneouslyj (hen 
perhaps direc( instrucMon might help Ihem. Ten children of each age group were 
given the following additional instruclions during Ihe encoding trials: 

You do i( like this. First you count the number of weights on 
this side " one^ two; three, four. Then you count (he number of pegs 
the weights' are from the cenler - first, second, third So you say 

yourself Mour weights on the third peg/ Then you would do the . 
same for the olher side - one^ (wo, thrbe, four^ five weights on (he 
first, second^ Ihird peg. So it would be five weights on the third peg* 
Then you would say 'tour vJeighls on Ihe third peg and five weights 
on third' peg.' Then you would put Ihe right number Qf we^fehts on 
(he right pegs on each side. Lei's practice one. 

This was followed by seven pracllce trials on which the child received feedback 
on the ^orrect counting of weights and distances. This * procedure was expected 
to reduce or eliminate the weight -distance distrepancy tor the younger 
children^ but since tlip^ older children presumably already knew how and what to 
encode^ it was (hoi expected to affect their performance, ^k> effect was expected on 
the predictions performance of either group. All of 1hese expectations were 
confirmed. Table 7 showci" lhat Ihe younger children performedl equall^^ell On weight 
and dietanccL and that the older children performed, as beforb, better overall, but 
with no weight-distance discrepancy. Tables 8 and 9 show that the predictions 
performance of both groups was indistinguishable from previous results. 

Experiment 3e; Having finally eliminated the encoding deficit between weight 
and distance for the younger children, the question remains^as to whether that 
deficit really wfis the cause of the differential responsiveness 'to instruction that 
w© initially set out to explain* In this final experiment, the same children who 
pj»rtijcipated in Experiment 3d 'were given the conflict training sequence used in 
Experiment 2 a few days after they completed 3d. According to the encoding 
hypothesis, both older and younger children shoOld now benefit from experience 
with conflict problems that previously had benefitted only the older children. 
Following the training sequence, the predictions test (without feedback) was again 
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given to the tw6 /groups* The results of this post-training predictions test are 
shown in row 3e of Tables 8 and 9> Note that rows 3d and 3o are based on the 
$ame set of subjects at different times. The sequence oT^anlpulations and their 
corresponding results were: i) Instructiorrs about what and how to encode* ii) encoding 
task [Table 7* 3dX iii) predictions task [Tables 8 and % 3dX M conflict training 
with feedback^ a few days later, v) repeat of predictions t^sk [Tables 8 and 9, 3e\ 

Comparison of rows d and e, in Tables 8 and 9 shows that training now 
aided both age groups. Although thef'e appears to be a sHght advantage Overall for 
the older children, there were noi significant effects for either age -alOne, or an 
age^problem type interactioa It seer^s ctear thcn« that the qualitative differences in 
responsiveness to training were eliminated by prior training in encoding. Although 
the younger children did not benefit as much as the older. It should be remembered 
that t'hctr encoding performance also did not reach the tevel of the older children. 



Representinfi the encoding process 1 

Let us return to the issue of the appropriate* representation for Kfiowledge 
about the balance scale. The results of Experiment 3 provide strong support for the 
encoding hypothesis: younger children clearly do not tend to encode the distance 
dimension in this task. Without such encodingf they can derive little benefit from 
the instruction series. However, if given careful and explicit instruction on ^needing, 
they do begin to do it correctly, and such improvement subsequently enables! them to 
benefit spontaneously from a training sequence. How can we reprcs|ent this 
phenomenon? 

One desirable property of a good representation for this situation Would be 
an expMcit model of the enqpding process. This would require repl^cin^ the 
Unmodctl&d encoding operators of tho kind used in the production, systehl/ for Pam 
(Fig Q) wilh exiffcit productions Jhal scanned the stimulus and returned jpme 
^T\cotie6 rcpn&i^&ntatibn. Another requirement would be a general self* 
modification capacity with two distinguishable capabililics. One capability would deal 
with the construction of procedi^^ lhat dirqctty followed instructions^ as did the 
children who Wrc told how to encode by counting. Another capability woutd 
represent the rulc^ir^ducMon or concept formation procedure that underlies learning 
from the training "serics.'f^am^s production systerri is at least miAinV^ly sensitive 
to feedback about the' correctness of Itie curre*)! hypolhesist muc)i r^ore remains to ^ 
be done. 

The const ruci ion of $uch a model woutd necessitate further specific 
assumptions about the precise nature of information processing that goes on in 
this situation, and such assumptions would have to be independently tested other 
experimental paradigmsi Such exiension might include' reaction time studies that 
compared conventional rcprcscniations wilh their symbolic equivalents (to bypass 
the encoding stage)* reconstruction memory for just* predicted probtemc* and more 
general rule induction lasks. ^ 



33 



Children's Knowledge draft 4 ' 32 

i, Types of KnowledRe in the Human Information Processing System 

Our exploration of the issues surrounding the evaluation of different 
representations for Knowledge has revealed that it is possible to distinguish 
between several different types of knowledge. The suitability of ^ representation 
^(Jepends upon the particular type of knowledge ' in which we are interested In 
this final section, we will briefly indicate what appear to ys to be distinctly 
different Kinds of Knowledge, The order in which they are described corresponds 
roughly to their degree of permanence and stability in the hum^n information 
processing system- ' / 

■ J 

Kl^ Knowledge about the momentary state of affair/ This is the knowledge 
represented by the elemenis in 5TM in a production systeni, 'or in the mOre^ 
general concept of "active memory" in other cognitive theories. In a production 
system^ alt the productions are continually attempting to recogniee familiar elements 
of Kl, and to act upon it throiigh modificatioa.Kl represenfi what is "going on" from 
one moment to the next. It contains; information about the environment that has been 
produced by encoding operalions, and by the actions pf satisfied productions. It 
constitutes a record of the system's immediate past. 

K2: Knowledge abdiit how to do a task or sdve a problem. This type of 
knowledge is represented by decision trees of the sort used in Figs 1 and 3* or by 
the productions in a production system. The Knowledge in K2 Vpi^^'ly consists of 
tests for the type of Knowledge represented by KL A procJuction system 
provides a convenient and flexible representation for Kl and K?, However, many of 
the explicit assutnplions in sii^Ji representations ' have .ho particutar psychological 
r^levance,^ whit0 dthersj allbough important, not be amenable to independent 

experimental verification. Thus Ihe^ evaliialion oT produption system representations 
for K2 rests upon multiple level .-converging empirical measures^ including globat. 
responses, protocols, and reaction limes, Allhough many particular assumptions^ may ' 
be unverifiable, the integrated behavior' of the total system can be observed^ and 
evaluated, ' 

K3: knowledge about hbw to descri^ K2, A frequently discussed issue In 
developmental psycliology concerns the relative validity of explanations versus 
pcrform'ante{cf, conlroversy' between Braine, 1964, and 5medslund> 1965), I" our 
experiments we found that the two forms of measurement wer^ highty correlated* 
although they did reveal some interesting difference? In the Model III children. It 
woiild seem that all explani^Jions tasks require that the child have a type of 
knowledge that is distinct from performance ^knowledge as sucti* although it is rarely 
modelled or represented explicitly in psychological theories, 

Kflr kr6wledge about how to modify K?' and 1^3- TKis is the knowledge 
required for Both learning in the long ternv ag^ immediate self ^modification according 
to task demands. Some c^f the general properties of represent^tidns for this sort 
of knowledge havfe bpen discussed by Klahr {1976a,b) 'tnd Newell (1972a), The 
content of would be a theory of learnings and it would be premature to even 
imply that such a full blown theory is near at hand. However^ recent and on-going 
work with 'self-modifying production systems suggests that this is a very promising 
form of representalion for (Neviell, 1976; Waterman, 1974)L 
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K5; knowletfge about how to interpret the ^nowtedgo stated at the other 
levels. This ' l<rfOw(eiige« would include, in the case of a production system 
representation, all the rules that the interpreter has to have in order to run a 
production system. It is the base level Knowledge in the system^ presumed to be 
functionally equivalent' to the basic system architecture. It is probably inaccessible 
lo introspection, or to' instruction, although it may undergo development. 



Conclusion 

Representation of children's Knowledge requires that we maKe testabli^ 
assertions about both the basic encoding of the environment and the processes 
that ^ operate on those encodings. Cognitive development ancT instructional 
procedures involve changes In both the encoding operators and the rule systems. 
Instruction will tend to be itieffective\ ff the instructional situation Is encoded by 
the learner In a manner ttet is unexpected by the instructor. In a limited domain, 
we^have demonstrated that such misencoding was indeed occurring, that ^we coutd 
locate thd^ point of difficuttyp eljjrninate it and have instruction proceed as we expected 

From a broader viewpoint, we have \n)&d to show that the appropriate 
representation for Knowledge depends upon the goals of the scientific endeavor, 
.J^iffOrent Klnd^ of Knowledge are best represented by different formalisms, and are 
best investigated by different empirical procedures, TMs pluralistic view of Knowledge 
representfition; may facilitate our underslanding of| and influence upor|| what tt Is that 
children know. 
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Table. 1 

Predictions for percentage of correct answers and error patterns 
on posttest for children using different models ^ 

Predicted 



Problem Type 




Models 


- 


Developmental Tr^hd 


• 




III 


IV 




Balance 


100 100 


100 


lod 


No change — all children 


mm 

A 








at high levels 


Weight 


100 100 


100 


ibo 


.No change — all children 


1 \\m 








at high level 



Distance 



0 100 
(Should 
say 

'♦balance") 



100 100 Dramatic iii;>rovement ' 
with age 



Conflict- 



100 . 100 

A 



weight 



TV 



33 100 
(Chance 
M responding)*' 



Decline with age 
Possible upturn in 
oldest £roup 




0 0 33 

(Shoufd (Should (Chance 

■ 

say say responding) 
"right "right ' 
down") down") 



In^rovement with age 



\ 



V 



Conflict- 
Valance 

Mi 



A 



V 0 ,0 33 100 

(Should (Should (Chance. 

say say * reisponding) 
"right^ "right 

down") <Jown") 



Improvement with age 



ra- 



table 2 / .. ^ 

Developmental trends observed and predicted 
on different problem^types in Experiment I 
(percentage of problems predicted correctly) 



Number of 
each tjrpe 


Problem Type 




Age 




Predicted Developmental 
Ttend (From Table I) 




Grade 


K-lst 


4th-5th 


8th-9th 


llth-12th 




Age (years) 


5-6 


9-10 


13-14 


16-17 




Mean age (mos) 


73 


120 


■ 169 


207 


4 


Balance 


94 


99 


99 , 


100 No change — All children 



at high level 



Weight 



88 



98 



9^ 



98 ' No change--All children 
at hiA level 



. Distance \ 9 



78 



81 



95 



Dram itlc improvement 



^th 



age 



6 Conflict- 86 74 

weight 



53 



51 Decline with age- 
Possible upturn for'olde 



Conflict- 
distance 



11 



32 



48 



50 Improvement with ag* 



6 



, Conflict- 
balance 



17 



26 



40 ' Itnprovetnent with age 



Weighted 
m^an % 



46 61 



62 



^7 



V. 
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Table 3 

Number o'f children fitting eadi model 



1 


11 


ILL 


IV 


Unclasslfiable 


23 


' 0 


0 


0 


7 


3 


9 


12 


2 


4 


3 


7 


17 


1 


2 


0 


6 


19 


S , 


0 


-2sr " • 


''22 


48 


8 


13 



43 



Table 4 

Number of children in Experiment 1 fitting each model- 
predictions and explanations criteria 

Rule by Predictions Criterion 
f ^ 







I 


II 


III 


IV 


ftule 


I 


23 


1 


0 


. 0 




II 


0 


7 


1 


0 


Explanations 


III 


b 




46 


Q 


Criterion 


IV 


0 


0 


0 


8 



■ ^ ^ ^ Table 5 - 

' Nimber of children uslng^ different models — Experiment 2 , 

Model I Model II Model III UnclassiAabK 





Control 


8 / 


0 


. 0 . 


.2 


5-year-oias 


Distance training 


3 


4 


1 


2 




Conflict training 


5 


0 


0 


5 




5's Total 


16 


4 


1 


9 




Control 


5 


3 


0 


2 


&-year**olds 


Distance training 


0 


8 


1 


1 




'Conflict training 


0 


2 


5 


3 




8's Total 


5 


13 


6 


6 




Grand Total 


21 


17 


7 


15 
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Table 6 

Pam on training sequence^ and predictions from 4 models 
Problem * ' Prediction 





' Ponf iffiiTfttio n 
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Table 7 

Percentage of (Correct encodings--Experiinent 3 




5-year-olds 



~ 8-year-olds 



Experiment 
3a 
3b 
3c 

3d 



Weight 
Encodings 



51 
54 
54 
52 




Distance 
Encodings 

16 

9 

19 

51 



Weight 
Encodings 

73 



64 
72 



Distance 
Encodings 

56 



V 73 
•76 
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Table 8 

Percentage of correct predictions— Experiment 3 



Experiment 



Age 



2 2 2, 6 6 6 

Balance Weight Distance Conflict- Conflict- Conflict- 
Weight ' Distance Balance 



3a 



3b 



5-yeal--olds' '95 
8-year-olds " 98 

5-year-odds 85 



100 
100 

85 



8 

18 



100 
100 

92 



2 
0 

8 



0 
0 



00 



3c 



3d 



3e 



'5-yeat-olds 
8 -year-olds 

S-year-olds 
^-y ear -olds 

5-year-olds 
8-year-olds 



72. 
100 

< 

72 
100 

100 



9or 

98 

92 
100 

89 
IDO 



18 
30 

22 
22 

72 

^' 94 



72 
90 

86 
100 > 

V 

89 
67 



12 
20 

17 

0 

33 
•SO 



IS 

"o 

6 
0 




^ f 

Table 9 , • 

Number of children using different models-* Experiment 3 

^^ules tised 

Experiment I II III Unclassifiable 



3a 



3c 



3d 



3e 



5-years 9 0.0 1 

8-years 8 1 0 1 



3b , 5-years 



5-years .7 0 0 3 

8-years 6 2 1 1 

5-years 6 0 0 4 

8-years 6 1 0 3 

5-Jrears 1 3 4 2 

8-years 0 3 7 ^ 0 



Figs and T&btes 
Reure 1 — 



Figure 2 

Figure 3 

Figure 4 
Figure 5 



Figure Captions 



-Deeision tree representations for four 



models of balance scate prod^tions 

Production system representations for. 
four models ^ ' 

Decision, tree representation for Pam*s 
prediction model 

Production system for Pam 

Trace of Pam's production system running on 
a conflict-distance problem 
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4^ 



Model II 



Gteatet Weight Down 



Balance, 



Gteatet Distance Down 




Models III and IV 



(III) 

- - r 



f muddle ^ 
, through , 



ERIC 



Greater Torque Down 



Model I 

P2:«Side X more W) --> (Say X "down")) 
PlK(Same W) --> (Say "balance")) 

Model 11 

■P3:((Same W) (Side X more D) -> (Say X "down")) 
P2:(($ide X more W) --> (Say X "down")) 
Pl:((Same W) -> (S«y "balance")) 

Model III . 

P5;((Side X more W) (Side X niore D) -> (Say X "down")) 
P4:((Side X more W) (Side X less D) --> muddle through) 
P3:((Samc W) (Side X more D) -> (Say X "down")) 
P2:((Sid6 X more W) -> (Sa^ X "down")) 
Pl:((Samc W) -:> (Say "balancft'*)) 

Model iV 

P7:((Side X more Torque) --> (say X ""down")) 
P6:((Srfmc Torque) — > (Say;"baiance")) 
P5:((Side X more W)'(Side X morn D) --> (Say X "down")) 
..-P4':((Side X more W) (Side X tess D),--> (get Torques)) 
P3:((Same W) (Side X mpre D) --> (S?y X "down")) 
P2:((Sfde X more W) -!■> (Say X "down")) 
Pl:((Same W) -> (Say "balance")) 



I -> II 

II -> 111 

III -> IV 



Transitional requirements 
Productions Operators 



add P3 



add P4, P5 

modify P4, 
add P6, P7 



add distance encoding and 
comparison 



acid lorquc computalion and 
comparison 
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■ ■ / 

* 




"big": 

weight: any single peg* n ^ 3 
distance; 3rd oif 4th peg 



big D 




big W 




down 




down 




8»13,15 


3,4 



big <crlterlon> 
down 



7,9,12,16 Cvei^t) 
5,14 jtdlst) 



<crlterlon> 

Initially; weight ^ 
after any, neg;* feedback: 

weight ^ distance 
or distance ^ weight 



Figure 3 ^ 
Model III - a 
(Pom) ^ 
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Figure A. PS tor Hl-A 
♦ 



OHCLASS wgt dst) D2:(CLASS wgt dst) ' ^ \ 

Pl:((pred) (wgt same) (made *t) (expect balance eveny$ay.b) 
P2:((pred) (wgt more XI) — ^ (made ••) (expect ^1 ciown) say.d) * 
P3;((pred) (wgt sgme) (dst more iil) — > (made ••) (expect XI down) say.d) 
P4:((pred) (wgt more)(dst niore) — > findbig) 

p5:((pred) (criterion 01)(D1 big X1KD2 big X2) — > (made ««) (expect XI down>say.d) 
P6:((pred) (wgt big XI) — > (made •*) (expect XI down) say^d) 
P7:((pred) (dst big XI) — > (made ••) (expect XI down) say^d) 
P8:((prcd)(Dl) abs "> ATTEND) 

el:((expect) look) 

e2:((expect xl x2)(5ee xl x2) — > (dtd ••)(see ■■-> sawKresulUorrcct)) 
e3:((expect xl x2)(see Hi x2) abs (see) — > (did ttHsee saw)(reitult wrong)) 

6wl:((result wrongMcritei'ion dst) — > (old *<^}(dst -■■> wgt)) 
6w2;((result wrong)(criterion wgt)^— > (old **)twgt dst)) 
sw3;((rcsult correct )(criterion) — > (old *•)) 

llnd.big;(OPR CALL) ;return5 (wgljdst big felt|right), one or two sutb,,- 
lookj(OPR CALL) ; looks lor result of balance tipping. ^ 

I returns (see lefl|rrght down) 
attend:(OPR CALL) ; initial encoding of same or difference on c^t & wgt 
treturns (wgt|dst sattie|more (ef1|rigtit) 




V 



/ 
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Figure 5. Trace of Pam's production system running on probtem 7. 
(0003/0020) 

Cycle 1 

- STM: ((PRED) (CRITERION WGT)) " • . 

TRUE: P8: ((PRED) (Dl) ABS "> ATTENCO 

Output from ATTEND (input to STM) ;;> (wgt more leftKdsI more rtgtit) 

Cycle 2 • 
ST»t4i ((DST MORE RIQHT) (WGT MORE LEFT) (PRED) (CRITERION WGT) ) ' 

CONFLIOT.SET: (P2 P4) 
TRUE: P4: ((PRED) (WGT MORE) (DST MORE> -> FIND.BIG) * 
- Output from FIND.BIG (input to STM) ::> (dst big.right)(wgt big left) . 

Cycle 3 ' ' . ' ' 

STM: ((WGT pIG LEFT)fClST BIG.RIGHT) (PRED) (WGT MORE LEFT) (DST MORE RIGH 
-T)-(CRITERION WGT)) / ' " 

CONFLICT.SET: (P2 PA P5 P6 P7). 
' ■ COMFLICT.SET: {PA P5) AFTER SPECIALCASE.ORDER *, .\ 
CONFLICT.SET: (P5) AFTER STM.ORDER 
TRUE: P5: ((PRED) (CRITERION Dl) (01 BIG XI) <D2 BIG XZ) (MADE **) (EXPE 
CT.Xl DOWN) SAY.D) 

<- ' 
%%%%%%%%%% LEFT down , 

Cycle A ■ . , ; 

STM; ((EXPECT LEFT DOWN) (MADE (PRED)) (CRITERION WGT),0«GT BIG LEFT) (DST 
-eiG RIGHT) (WGT MORE LEFT) (DST MORE RIGHT)) 

TRUE: El: ((EXPECT) --> LO0K)i 

Output from LOOK (input to STM) ::> (see rigtit down) 

C^cle 5 

STM: ((SEE RIGHT DOWN) (EXPECT LEFT DOWN) (MADE (PRED)) (CRITERION WGT) (W 
GT BIG LEFT) (DST BIG RIGHT) (WGT MORE LEFT) (DST MORE RIGHT)) 
CONFLICT.SET: (E1,E3) 

TRUE: E3: ((EXPECT XI X2) (SEE XI X2) ABS (SEE) -> (DID **) (SEE SAW) 
(RESULT WRONG)) ^ ■ . ' 



Cycle 6 

-SIM: ((RESULT WRONG) (DID (EXPECT LEFT DOWN)) (SAW RIGHT DOWN) (MADE (PRE 
0)) (CRITERION WGT) (WGT BIG LEFT) (DST BIG RIGHT) (WGT MORE LEFT) (DST MORE R 
IGHT)) 

TRUE: SW2: ((RESULT WRONG) (CRITERION WGT) -> (OLD **) (WGT — > DST)) * 
Cycle 7 

STM: ((OLD (RESULT WRONG)) (CRITERION DST) (DID (EXPECT LEFT DOWN)) (SAW 
RIGHT DOWN) (MADE (PRED)) (WGT BIG LEFT) (DST BIG RIGHT) (WGT MORE LEFT) (OSr 
MORE RIGHT)) 
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Appendix A. Protocol excerpts of ^-year old on traing sequence. 



E. 
S. 
E. 
S. 
E. 

S. 
E. 
S. 
E. 

S. 

E. 
S. 



00400 
00500 
006€0 
00700 
00300 
00900 
01000 
01100 
01200 
01300 
OUOO 
01500 
01600 
01700 
01800 
01900 
02000 
02100 
02200 
02300 
02400 
02500 
02600 
02700 
02800 
02900 
03000 
03100 
03200 
03300 
03400 
03500 
03600 
03700 
03800 
03^ E. 
b400Cr-S. 
04100 E. 
04200 

04 

04500 
04600 
04700 
0 

OA 

05000 



Tl 0001/2000 4:46, 



Okay. Let's put these two here, and this one here. 
This side will go down (points left). 
Which side? touch the side that will go down, 
(touches left side) 

Okay. Let's see if yotu^were right. [Removes blocks. Scale tips; " 
left-up;ri6ht-down.] Were you right? ' . , ^ 

(nods no) . ' 

Which side went down? 

(points right) . ' - - ^ 

Okay. Why do you think that was? Why did you think tiefore this, side 

would go down? ^ ■ ■ \ • 

•Cause that one (points left) didn't have.as much as that on© (points 

right). * " 

Uh-huh. But v^liat actually happened? 

This side went down because thai one's heavier (points right). 



T3 0100/1000 6:10 



E. 
S. 
E. 
S. 
E. 

S. 
E. 

S. 
E. 
S. 



Okay. What -do you think will happen this time? 
They will both stay up. 
Why cfo you think that? ^ ■ 

Xause they are bofh the same. 

Let's, see if you ar« right. [Rerfioves t>locks. Scale tips:Left 
down.] Were you ri^bt? 
(nods yes) "'^...^^^ 

•You were? Look. Do they both.,;Are they balanced? Is it like it was 
before? " ' - ' 

Welt, why ar^ they both the same thing and one's up and one's down? 
Why do you think that is? , • 

I don't kfiow. 



T4 0020/0020 7<X> 




Okay. What do y^u think will happen this: time? 
The, same again. 

Tjiey will stay the same agairii Why do you think that? 

'CausB. Wait a minute. It won't, 

It won't? • ' . ■ * 

'Cause this orie (points left) is'ctpser to this onis (points to fulcrum). 

Mdlhis one (points right) is closer to tNs one (points to fulcrum). 

So wti9fe.will happen? 

IRttis side (points right) will go up. ^ ' ^ 

This side will go up? 
Uh-huh. . ' 

Okay. What do you me^n by "up"? Point which way it will go, ' 
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05400 

05200 

05300 

05400 . 

05500 

05600 

05700 

05800 

05900 

06000 

06100 ~ 

06200 

06300 

06400 

06500 

06600 

0S70D 

06800 

06900 

07000 

07100. 

07200 

07300 

- 07400 
07500 
07600 

<»7700 
07800 
07900 
08000 
P8100 
0820^ 
08300 
08400 
08500 
08600 
08700 
08800 
08900 
X>9000 
09100 

'09200 
09300 
09400 
09500 
09600 
09700 
09800 
09900 
10000 



S. 
E. 
S. 
E. 
S. 
E.. 



I think...- 
Which? 

... it will go down. I \ 
This side wiH go dowWpoir 



joints left) 7 

Uh-huh.(Nods "yes") 

And this side ... and so it will be like this ?(tilts balance 
manually : left-downiright-up) 
Ufi-huh. 
Is that right? 
Uh-huh, 

Ek^ Ok ay,, let's see if you are right. [Removes, blocks. Scale tips: 

« nghl-down] Were you right? 
S, {nods no) 

What happened? 
This went down (points right). 
Why do you think that is? 
I don't know! , 
Well/think about it. 
Ummmm. 
Okay. 

I just don't know why. 
You just don't know why. 
Uh-huh. 

Well, we'll keep on working and maybe you'll figure it out. 



E. 
S. 
E. 
S. 
E. 
S. 
E. 
S. 
E. 
S. 
E. 



T6 0102/?010 9i43 

E. Okay, what will happen on this one? 

S.^ Yes. This side (points right) will both stay the same (points to 

both sides). 
E. Let's soe if ...Why do you think that? 

S. Because they both look the .same. One is empty in the middle and 

one ts empty tn the middle. 
E, Okay, (scale balances).. We re you right? 
S. (nods yes) 

E. Uh-huh. You were. That's right. 
S. I was right! 
E. That's right. 



T7 02QO/2000 10:25 

■E, All-righty. Now, what Will happen this time? ^"'^^ ~— 
S. This side (points left) is .farther away from this, (indicates 

fulcrum) and this side (points right^s closer to this. 

(indicates fulcrum) So, I think this side (^xynts left) wil 

up. And this side will go down (points right 
E. .Let's see if you are right.(re moves blocks ilef I -dowoTIWet^vou right?' 



go 



\ 
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10160 S. 

10200 E. 
10300 S. 
10400 E. 
10500 S. 
10600 
10700 E. 
10800 S. 
10900 E. 
11000 
11100 
11200 
U3p0 E7 
lUOO 
11500 S. 
11600 
11700 
11800 E. 
11900 
12000 S. 
12100 
12200 E. 

1-2400 E~^ 
12500 

12700 E. 

12800 1 

12900 E. 

1300Q S. 

13100 

13200 E. 

133P0 

T3400 S. 

13500 E. 

13600 S. 

13700 E. 

13800 S- 

13900 E. 

14000 

14100 S.' 

14200 

14300 E. 

14400 S. 

14500 

14600 

14700 E8 

14800 

14900 E 

15000 S. 



Huh-uh.(fM)) 

What happene^i? 

(points left, center, right and up) 

What? 

This went up {points right) and this went down (points left). 

I thought this would go up (points left). 

Okay. Try to figure out what's happening. • 

H'm. I don't know why. ' 

Well you just keep On trying to figure out. 



0003/0004 26:46 

fm ready. Ha, wait a minute. I forgot. I did it wrong/ 1 gotta think 
„Xcan't hear). This is lour This is three. This one will go down 
(points right), 

yVhat do you thinK woutd happen if we put One more here? What do you 
think would happen? [0004/0004] 

Both stay the same. This dne is crooked a IHtle bit (adjusts right 
weights). 

Vyhat do you thinkll happen? 
Stay the same. \ 

Yeah? Let's see if youVc right, [Removes blocks. Scale tips 
rigM^own, with sharp rap\as it hits tablaJDid they? 
No» \^ \ 
Wo? No, they didnl, Oid the^^? 
■Plunk, Plunk, \ 
Plunk! Why do you think thatWas? 

I don't know. They both had f©ur. See, One-two, (counts left) One-twO 

-three-four; (counts right) OneVtwo-three-four, 

They both have four. Js that wnat made this side go down so much 

and this side go up so much? \ 

No, 

What do you think it was? 
I don't know. 

Think about it. What could ft be? 
I just dOn*t know. 

Just don't know. Look at it for a moment and try to fjgiire out 

what it could be, R^al carefully, \ 

This One is far away (points right) and this one\is close (points. 

left). , *\ 

Okay. Have any othex ideas? \ 

Unh-unh(No). 



0003/3000 28:40 

Okay. Now, want to make up another probl&m? 
Uh-huh. 



58 



* Children's Knpw^ledge Appendix A \ 4 



15100 




Okay. 


15200 


s. 


This one is gonna be a good one. Stay the same. 


15300 




You think so? * ■ p 
Uh-huh, . 


15400 


S. 


15500 


E. 


Okay, let's see if youVe right. [Removes blocks. Scale balances] 


15600 




Were you right? 


15700 


S. 


Uh-huh! • 


15800 


E. 


Veah, you were. 


15900 


S. 


Fm being right and right and right, but one time I was wrong. 


16000 






16100 






16200 






16300 


E9 


0003/0003 ' 29:26 » 


10400 






16500 






16600 


E. 


[Reciuests inforn>dtion on how scale workss^ and > 


16700 




about what would happen or^ this trial] 


16800 


S. 


There's three, and this side (points right) would go down* t guess. 


16900 


E. 


That side would go down? , 


17000 


S, 


And this side would go up (points leftX 


17100 


E. 


Why? 


17200 


S. 


Because this is fajvaway (poij;»ts right) and this (s close (points lelft). 


17300 




So I thirtk il would 


-17400 


E, 


Think so? 


17500 


S.' 


Uh-huh. N 


17600 


E. 


Let's see if youVe right. 


17700 


S. 


Ohh! Right! 


17800 






17900 


E. 


What would you do to make it balance, now? [S; starts 


18000 




to move scale manually to balance position] ^fo.»I mean by 


J8100 




moving the little„.little circles around. What could 


'18200 




you do to make that balance? 


18300 


-s. 


This three here (points to right, first peg), and Ihis three stay 


18400 




here (points left). [0003/3000] 


18500 


E. 


Let's see if that's rights what you do. 


18600 


S. 


I have to holcJ this up. (fifts right side and moves weights). [0003/3000] 


18700 


E. 


Are you right? 


18800 


' S. 


(nods yes) 


18900 






19000 


E. 


What would you do to make the other side go down? 


19100 


S. 


Whoops. [3000/3000] That side wilf go up. [points right] Whoops^ there. 


"19200 


E. 


Why does that nappen? 


19300 


S. 


Because that one'? far away (points lelt) and that one's close (points 


19400 




right). y 


1'9500 


E. 


I see. . ^^^^^.^ 


19600 






19700 


S." 


But if I both had them far away. [3000/0003] Both sides would go 


19800 




down, (giggle) They balance. * 


19900 
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Appendix B 

Trice of ps tor Model III-A, orvfour probtems 

>»run on problem 5. assume criterion set to distance 

>t <0200/0400y ' " , ' ^ 

a STM: ((PREO) (CRITERION DST)) 
TRUE: P8: ((PRED) (Dl) ABS --> ATTEND) 

ATTEWDING - INPUT NEXT STIMULUS - >(wgt more rightMdst more 

X STM: «DST MORE LEFT) (WGT MORE RIGHT) (PRED) {CRITERION DST) ) 
CONFLICT.SET: (P2 P4) 
TRUE: PH: ((PRED) (WGT MORE) (DST MORE) -> FlWaBIG') 

ATTENDING - INPUT NEXT STIMULUS - >(wgt big right)(dst big le 

2.^STM: ((DST BIG LEFT) (WGT BIG RIGHT) (PREO) (WGT MORE RIGHT) (pST 
-TXCRITERIQN DST)) 

COnFLICT,SET! (P2 P^ P5 P6 P7) " 
CONFLICT.SET; {PH P5) AFTER SPECIALCASE.ORDER 
CONTLICT-SET! (P5) AFTER STWORDER ^ 
TRUE: P5: ((PRED) (CRITERION Dl) (Dl BIG.XI ) ^D2 BIG X2) (MADE 
CT XI DOWN) SAY.D)" 

tttttttttt LEFT down 

6. STM; «EXPECT LEFT DOWN) (MADE (PRED)) (CRITERION DST) (DST BIG L 
BIG RIGHT) (WGT MORE RIGHT) (DST MORE LEFT)) 

TRUE: El: ((EXPECT) -> LOOK) *- , 

ATTENDING - INPUT NEXT STIMULUS = >(see right down) 

7. STM! ((SEE RIGHT DOWM) (EXPECT LEFT DOWN) (MADE (PRED)) (CRITERIO 
ST BIG LEFT) (WGT BIG RIGHT) (WGT MORE RIGHT) (DST MORE LEFT))- 

CONFLICT-SET; (El E3) 
TRUE: E3: ((EXPERT XI X2) (SEE XI X2) ABS (SEE) -> (DID **) (SEE - 
(RESULT WRONG)) 

JO. STM; ((RESULT WRONG) (DID (EXPECT LEFT DOWN)) (SAW RIGHT DOWN) ( 
D)) (CRITERION DST) (DST BIG LEFT) (WGT BIG RIGHT) (WGT MORE RIGHT) ( 
LEFT)) . 

TRUE; SWl! ((RESULT WRONG) (CRITERION DST) -> (OLD **) (DST — -> W 

12. STM: ((OLD (RESULT WRONG)) (CRITERION WGT) (DID (EXPECT LEFT DOW 
RIGHT DOWN) (MADE (PRED)) (DST BIG LEFT^ (WGT BIG RIGHT) (WGT MORE RI 
MORE LEFT)) V 
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>jinow do (jroblem 6. Keep criterion 
TE: ((0102/2010)) 

0. , STM; ((PRED) (CRITERION WGT)) 

CONFLICT.SET: (P8) .. ' 

TRUE: P8: «PREO) (01) ABS -> IftTTENO). ' 

ATTENDING - INPUT NEXT STIMULUS - >(dst same)(wgt same) 

1. STMj ((WGT SAME) (OST SAME) (PREQ) (CRITdRlON WGT) 
) • 

TRUE: Pli {(PREO) (WGT SAME) -> (MADE *•) (EXPECT BALANCE EVEN) SA 

balance 

5. STM: ((EXPECT BALANCE EVEN) (MADE (PRED)) (WGT SAME) (DST SAME) ( 
WGT)) \ . , ' 

TRUE: El: ((EXPECT) -> LOOIJV ^ 

\^ATTENDING - INPUT NEXT STIMULUS = >(see balance even) 

6. STM; ((SEE BALANCE EVEN) (EXPECT BALANCE EVEN) (MADE (PRED)) (WGT 
ST SAME) (CRITERION WGT)) 

COMFLICT.SET: (EI E2) 
TRUE: E2: ((EXPECT XI X2) (SEE XI X2) -> (DID ••) (SEE -«> SAW) ( 
RRECT)) 

*^ 

9. STM: ((RESULT CORRECT) (DID (EXPECT BALANCE EVEN)) (SAW BALANCE E 
.E-(PRED)) (WGT SAME) (DST SAME) (CRITERION WGT)) 

TRUE: SW3: ((RESULT CQRRECT) (CRITERION) --> (OLD **)) 

10, STM: ((OLD (RESULT CORRECT)) (CRITERION WGT) (DID (EXPECT BALANC 
•(SAW BALANCE EVEN) (MAQE (PRED)) (WGT SAME) (DST SAME)) 
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>inext problem 7 (0003/0020) 

0. STM! ((PRED) (CRITERION WGT)) ' 

COhFLICT.SETi (P8) 
TRUE! P8! ((PRED) (Dl) ABS --> ATTEND) 

ATTENDING - INPUT NEXT STIMULUS - >(wgt mOre leftKdst mOre r 

1. STM: ((DST MORE RIGHT) (WGT MORE LEFT) (PRED) (CRITERION WGT) ) 

<!:ONFLICT.SET: (P2 P^) 
TRUE: P4: ((PRED) (WGT MORE) (DST MORE) -> FIND.BIG) 

ATTENDING - INPUT NEXT STIMULUS - >(dst big rtgh()(wgt big le 

2. STM! ((WGT BIG LEFT) (DST BIG RIGHT) (PRED) (WGT MORE LEFT) (DST 
T) (CRITERION WGT)) 

. .._ CONPLICT.SET: (P2 P^ P5 P6 P7) 

CONrLlCT.SET: (P^ P5) AFTER SPECIALCASE.ORDER • 
CO.NFLICT.SET: {P5) AFTER STM.ORDER • . • 

TRUE: P5: ((PRED) (CRITERION Dl) (DI BIG XI) (D2 BIG X2) -> (MADE 

CT XI DOWN) SAY.D) • , 

LEFT down i 

6. STM; ((EXPECT LEFT DOWN) (MADE (PRED)) (CRITERION WGT) (WGT BIG L 
BIG RIGHT) (WGT MORE LEFT) (DST MORE RIGHT)) 

TRUE: El: ((EXPECT) --> LOOK) 

ATTENDING - INPUT NEXT STIMULUS = >(see right down) 

7. STM: ((SEE RIGHT DOWN) (EXPECT LEFT DOWN) (MADE (PRED)) (CRITERIO 
GT BIG LEFT) (DST BIG RIGHT) (WGT MORE LEFT)-(DST MORE RIGHT)) 

CONrLIpT.SET: (E3) AFTER SPECIALCASE.ORDER 
TRUE: E3: ((EXPECT XI X2) (SEE XI X2) ABS (SEE) --> (DID »») (SEE - 
(RESULT WRONG)) 



10. STM: ((RESULT WRONG) (DID (EXPECT LEFT DOWN)) (SAW RIGHT DpWN) ( 
D)) (CRITERION WGT) (WGT BIG LEFT) (DST BIG RIGHT) (WGT MORE LEFT) (D 
IGHT)) 

TRUE! SW2: ((RESULT WRONG) (tPITERION WGT) --> (OLD »») (WGT ™> D 

12. STM! ((OLD (RESULT WRONp)) (CRITERION DST) (DID (EXPECT LEFT DOW 
RIGHT DOWN) (MADE (PRED)) (WGT BIG LEFT) (DST BIG RIGHT) (WGT MORE LE 
MORE RIGHT)) 
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>;prob 8 <0l00/0200} notice, this has big dsti but not big wgt 
> 

0. STM: ((PREb) (CRITERION DST)) 

^ TRUE: P8:((p)iED) (Dl) ABS---* ATTEND) 

ATTENDING - INPUT NEXT STIMULUS - >(wgt more right)(d8t,more 

1. STM: ((DST MORE LEFT) (WGT MORE RIGHT) (PRED) (CRITERION DST) ) , 
' CONFLICT.SET: (P2 P4) 

TRUE: PA: ((PRED) (WGT MORE) (DST MORE) --> FIND.BIG) 
ATTENDING - INPLTT NEXT STIMULI^ - >(d8t big left) 

2. STM: ((DST BIG LEFT) (PRED) (WGT MORE RIGHT) (DST MOFE LEFT) (CRI 
T» - - - 

CONFLICT.SET: (P2 P4 P7) 

(iONFLICT.SET: (P4 P7) AFTER SPECIALCASE.ORDER 
CONFLICT.SET: (P7) AFTER STM.ORDER 
TRUE: P7: ((PRED) (DST BIG XD --> (MADE »«) (EXPECT XI DOWN) SAY.D 

********** LEFT down 

6. STMi ((EXPECT LEFT DOWN) (MADE (PRED)) (DST BIG LEFT) (WGT MORE R 
jr MORE LEFT) (CRITERION DST)) 

TRUE: Eh ((EXPECT) --> LOOK) 

ATTENDING - INPUT NEXT STIMULUS - >(sce right down), / 

7. STM: ((SEE RIGHT DOV^N) (EXPECT LEFT DOWN) (MADE (PRED^ (DST BIG 
T-MORE RI6HT) (DST MORE LEFT) (CRITERION DST)) . \/ 

CONFLICTSET; {El E3) . ^ 

TRUE: E3: ((EXPECT XI X2) (SEE XI X2) ABS (SEE) -> (PID **) (SEE - 
(RESULT WRONG)) . - 

■■ • ■ . 

10. STM: ((RESULT WRONG) (DID (EXPECT LEFT D^N)) (SAW RIGHT DOWN) ( 
D)) (DST BIG LEFT) (WGT MORE RIGHT) (DST MOftf LEFT) (Cf?ITERION'DST)) 
TRUE: SWl: ((RESULT WRONG) (CRITERION DST) -> {OLD *«) (DST — W 

I 

12. sYM: ((OLO (result WRONG)) (CRITERION WGT) (DIO (EXPECT LEFT DOW 
RIGHT DOWN) (MADE (PRED)) (DST BIG'LEFT) (WGT MORE RltiHT) (DST MORE L 
NIL) 



